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Two  instructors  and  40  students  in  freshman  composition 

classes  at  the  University  of  Florida  participated  in  this 

study.   For  each  instructor,  10  randomly  selected  students 

engaged  in  self-evaluation  of  first-draft  essays,  responding 

to  written  revision  guides  containing  prompts  for  revising. 

Another  group  of  10  students  exchanged  essays  and  responded 

to  the  revision  guides  for  each  other's  essays.   Holistic 

scorers  rated  the  quality  of  all  first  and  final  drafts.   All 

revisions  were  identified,  coded,  counted,  and  tabulated  by 

the  researcher.   Sixteen  of  the  40  participating  students 

were  interviewed  regarding  their  perceptions  of  the  course. 

Findings  included  a  significant  difference  between  all  first 

and  final  drafts,  and  a  significant  difference  between 

students  of  the  two  instructors  in  terms  of  large-scale 
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revising.   No  statistical  difference  in  mean  holistic  scores 
between  treatment  group  was  found.   Also,  no  significant 
difference  was  found  for  the  effect  of  topic  on  changes  in 
holistic  scores  from  first  to  final  drafts.   Interviews 
suggested  an  inability  on  the  part  of  students  to  reconstruct 
accurately  composing  behavior  and  a  greater  concern  with 
pleasing  instructors  than  learning  how  to  write  well. 
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CHAPTER  ONE 
INTRODUCTION  TO  THE  STUDY 


As  students  progress  through  school,  they  too  seldom 
become  aware  of  the  benefits  of  revision  in  compositional 
writing,  partly  because  fewer  than  one  quarter  of  public 
school  students  are  asked  to  revise  the  papers  they  hand  in 
as  a  regular  part  of  writing  instruction  (National  Assessment 
of  Educational  Progress,  1986) .   For  too  many  students, 
writing  remains  a  secretive  process  in  which  they  do  their 
writing  in  private  and  submit  it  to  a  teacher  who  reads  and 

<    evaluates  it,  also  in  private.   This  traditional  pattern  in 
the  teaching  of  writing  does  little  to  help  students  gain  the 

I        kind  of  audience  awareness  that  professional  writers  use  to 
turn  unsuccessful  first  drafts  into  successful  final  drafts. 

Composition  instructors  have  the  responsibility  of 
helping  students  to  become  sensitive  to  the  need  for  revision 
and  to  learn  how  to  revise  effectively.   In  their  efforts  to 
meet  this  responsibility,  writing  teachers  may  seek  guidance 
in  research  literature.   As  shown  in  Chapter  Two,  the 
scholarly  literature  related  to  writing  instruction  contains 
an  increasing  number  of  articles  emphasizing  the  need  to 
provide  students  with  appropriate  feedback.   The  primary 
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sources  of  this  feedback  are  the  teacher,  the  students' 
.   ^     peers,  and  the  students  themselves. 

The  study  described  in  this  dissertation  focused 
attention  on  self-provided  evaluation  and  peer-provided     -; 
evaluation  as  sources  of  feedback  in  first-draft  essays. 
These  two  sources  of  feedback  have  been  isolated  so  that 
their  effectiveness  in  prompting  needed  revisions  may  be 
compared.   The  practical  question  addressed  in  this  study   ;' 
was,  "Do  students  who  evaluate  each  other's  first  drafts  as  a 
regular  feature  of  instruction  engage  in  different  revision 
behaviors  and  produce  better  final  drafts  than  students  who 
evaluate  their  own  first  drafts?" 

To  answer  this  question,  the  researcher  created  a  series 
of  "revision  guides,"  based  on  models  (Beach,  1979;  Flanigan 
&  Menendez,  1980)  described  in  the  research  literature. 
These  revision  guides  were  introduced  to  students  as  a  normal 
component  of  classroom  instruction.   Half  of  the  students 
participating  in  the  study  used  these  revision  guides  to 
evaluate  their  own  first  drafts  of  essays  written  for  a 
freshman  composition  course.   The  other  half  used  the  guides 
to  evaluate  the  first  drafts  of  their  peers'  essays.   As  will 
be  described  in  Chapters  Four  and  Five,  the  essays  of  self- 
evaluating  and  peer-evaluating  groups  were  compared  using 
both  quantitative  and  qualitative  methods  to  determine  if  any 
differences  could  be  discerned  that  might  be  associated  with 
these  two  methods  of  eliciting  feedback. 


Hypotheses  Tpsted  in  the  Study 

To  compare  the  results  of  the  revision  based  on  self- 
evaluation  and  revision  based  on  peer  evaluation,  the 
following  primary  null  hypotheses  were  tested: 

1.  There  will  be  no  difference  in  mean  holistic 
score  between  first  drafts  and  second  drafts 
averaged  over  the  two  treatment  groups  and  the 
four  topics. 

2.  There  will  be  no  difference  between  the  two 
treatment  groups  in  terms  of  the  degree  of 
change  in  holistic  score  from  first  draft  to 
final  draft;  i.e.,  there  will  be  no  draft-by- 
treatment  interaction. 

3.  There  will  be  no  difference  among  the  mean 
holistic  scores  achieved  on  each  of  the  four 
different  topics  addressed  in  the  students' 
essays . 

4.  For  each  of  six  levels  of  texual  complexity,  there 
will  be  no  difference  between  the  two  treatment 
groups  in  terms  of  the  amount  of  revision  in 
students'  essays. 

In  addition  to  these  hypotheses,  the  following  research 

questions  were  investigated: 

1 .  What  will  be  the  nature  of  a  sample  of 
specific  revisions  made  by  these  students  on 
first-draft  essays? 

2.  What  will  be  the  nature  of  a  sample  of 
specific  written  responses  made  by  these 
students  to  the  revision  guides  employed  in 
the  study? 

3.  In  their  responses  to  interview  questions,  how 
will  a  sample  of  these  students  characterize 
their  own  revising  behavior? 

4.  In  their  responses  to  interview  questions,  how 
will  a  sample  of  these  students  characterize 
the  helpfulness  of  the  experimental  treatments 
they  experience? 
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5.    In  their  responses  to  interview  questions,  how 
will  a  sample  of  these  students  characterize 
their  own  improvement  as  writers  over  the 
course  of  the  study? 

The  study  was  replicated  using  two  instructors;  thus,  each  of 

the  hypotheses  and  questions  was  investigated  for  two 

independent  samples  of  students.  '■;"■'.- 

Sianif-i  ranee  of  the  f^tndy 

Teachers  of  writing  make  a  major  decision  when  they 
include  or  exclude  self-evaluation  or  peer  evaluation  as 
part  of  instructional  methodology.   Although  the  need  for       .  -i, 
self-evaluation  has  been  recognized  by  several  researchers  ■   ■    . 
(Beach,  1989;  Beaven,  1977;  Flanigan  &  Menendez,  1980),  there 
is  disagreement  about  the  merits  of  peer  evaluation.   One 
group  of  researchers  (Bruffee,  1984;  Elbow,  1981;  Lagana,        .  ^' 
1972;  Moffett,  1968;  Nystrand,  1986,  1989;  Nystrand  &  Brant, 
1989)  claim  that  peer  evaluation  is  an  appropriate  and 
salutary  method  of  promoting  learning  about  writing. 
According  to  these  researchers,  peer  evaluation  provides  the 
student-writer  with  an  audience  other  than  the  instructor.     \~  "S' 
Moreover,  peer  evaluation  allows  the  writer  to  see  his  or  her  "  ' 
work  from  another  person's  perspective  before  handing  a  paper 
in  to  the  instructor.   Furthermore,  peer  evaluation  allows 
the  writer  to  see  how  other  students  write,  thereby  providing 
insight  into  alternative  ways  of  approaching  the  assigned 
essay.   A  second  group  of  researchers  (Carter,  1982; 
Freedman,  1987;  George,  1984;  Graner,  1985;  Newkirk,  1984; 
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Ziv,  1983)  question  the  value  of  peer  evaluation.   They  point 
out  that  peers  may  not  know  enough  about  writing  to  offer 
real  help  to  their  classmates.   Peer  evaluation,  they  say,  is 
a  case  of  the  blind  leading  the  blind.   Secondly,  students 
with  strong  personalities  may  talk  fellow  students  into 
taking  bad  advice  or  reject  good  advice  offered  by  less 
assertive  students.   Furthermore,  these  researchers  have 
found  that  students  are  reluctant  to  criticize  each  other's 
writing,  because  doing  so  might  be  interpreted  as  insulting 
and  have  negative  interpersonal  consequences.   Finally,  peer- 
evaluation  activities  have  been  characterized  as  invitations 
for  students  to  waste  time  by  engaging  in  irrelevant  social 
chatter. 

This  study  was  an  attempt  to  document  the  effects  of 
self-evaluation  and  peer  evaluation  under  controlled 
conditions.   By  isolating  self -evaluation  and  peer 
evaluation  as  treatment  variables  and  comparing  the  effects 
they  have  on  revising  behavior  and  essay  quality,  the 
researcher  hoped  to  develop  evidence  which  may  help  clarify 
some  of  the  points  of  disagreement  regarding  these 
instructional  techniques . 

LJmi  tat  inns  nf  thp  f^tudy 

This  study  was  limited  in  several  ways.   First,  the 
size  of  the  sample  (2  instructors,  40  students,  160  essays) 
may  have  produced  findings  that  were  less  representative  of 
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typical  college  freshman  writing  than  would  have  been  the 
case  if,  for  example,  all  students  enrolled  in  freshman 
composition  at  the  University  of  Florida  for  a  given  semester 
had  been  studied  in  detail.   Secondly,  to  preserve  the 
naturalness  of  the  environment  being  studied,  the  researcher 
made  no  attempt  to  directly  observe  or  record  the  dynamics  of 
the  four  classes  involved  in  the  study.   Data  directly 
bearing  on  the  findings  of  this  study  may  have  been  missed    -, 
because  of  this  limitation.   Finally,  the  fact  that  no 
control  groups  were  included  in  the  design  of  this  study 
limited  the  range  of  conclusions  which  could  be  drawn  from 
the  data.   The  design  of  the  study  allowed  only  conclusions 
comparing  each  of  the  two  treatments  against  the  other. 

Definition  of  Terms 

The  following  terms  used  in  this  study  should  be 
understood  in  light  of  the  following  definitions: 

Revision  guides  are  researcher-prepared  written 
questions  and  directions  designed  to  guide  students  as  they 
considered  their  first  drafts  before  making  needed  revisions. 
A  different  revision  guide  was  designed  for  each  essay 
written  by  students. 

Self -evaluation  is  a  procedure  in  which  students  wrote 
responses  to  the  questions  and  directions  in  the  revision 
guides  before  revising  their  own  first  drafts. 
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Peer  evaluation  is  a  procedure  in  which  pairs  of 
students  met  face-to-face  during  class  time  to  exchange 
written  responses  to  the  revision  guides  for  each  other's 
papers  and  to  discuss  each  other's  first  drafts.   These 
discussions  were  based  on  but  not  limited  to  the  students' 
written  revision  guide  responses . 

Revisions  are  differences  between  first  and  final  drafts 
of  essays  discernible  through  a  line-by-line  comparison  of 
the  two  drafts,  occurring  at  six  levels  of  textual 
complexity,  following  Bridwell  (1980) :   surface,  word, 
phrase,  clause,  sentence,  and  multisentence . 

A  first  draft  is  the  first  typed  draft  submitted  in 
class,  after  which  students  responded  to  revision  guides. 
These  drafts  may  or  may  not  have  been  preceded  by  preliminary 
drafts  written  by  students  before  the  first  draft  was  due. 

A  final  draft  is  the  draft  of  an  essay  submitted  for 
a  final  grade.   In  some  cases,  students  wrote  additional 
drafts  between  the  first  and  final  drafts  submitted  in 
class . 

Organization  of  the  Dissertation 

Chapter  One  of  this  dissertation  contains  an 
introduction  to  the  subject  of  the  study  and  includes  the 
study's  hypotheses,  research  questions,  significance, 
limitations,  and  terms.   Chapter  Two  is  a  review  of  the 
research  literature  related  to  this  study.   The  design  of  the 
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study  is  presented  in  Chapter  Three.   Quantitative  findings 
are  given  in  Chapter  Four.   Qualitative  findings  are  given  in 
Chapter  Five.   A  general  discussion  of  findings  with 
conclusions  and  recommendations  is  presented  in  Chapter  Six. 


CHAPTER  TWO 
REVIEW  OF  RELATED  LITERATURE 

This  chapter  is  a  review  of  scholarly  writing  related  to 
the  nature  of  revision,  self-evaluation,  and  peer  evaluation 
in  the  composing  process.   In  addition,  scholarly  writing 
which  reveals  the  effects  that  revision,  self-evaluation,  and 
peer  evaluation  have  on  the  quality  of  student  writing  is 
reviewed  in  this  chapter.   The  first  section  of  this  chapter 
contains  a  description  of  the  developing  theoretical  models 
of  revision  reflected  in  the  research  literature.   The  second 
section  is  a  survey  of  scholarly  writing  regarding  the  nature 
of  revision  in  the  writing  of  composition  students.   The 
third  section  is  a  discussion  of  self-evaluation  and  its 
effects  on  the  quality  of  student  writing.   The  fourth 
section  of  this  chapter  is  a  review  of  scholarly  writing 
about  peer  evaluation  and  its  effects  on  the  quality  of 
student  writing. 

The  Developing  Model  of  Revision 

To  be  meaningful,  any  discussion  of  how  the  concept  of 
revision  has  grown  within  the  composition  research  literature 
must  be  embedded  in  a  discussion  of  the  evolving  concept  of 
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the  writing  process.   Fitzgerald  (1987)  offered  the  following 

synopsis  of  the  dynamic  forces  which  combined  to  propel 

writing  research  forward: 

In  the  1970s,  several  factors  converged  to 
dramatically  affect  the  study  of  writing 

(Scardamalia  &  Bereiter,  1986) ,   The  public  and  the 
educational  community  were  increasingly  concerned 
about  writing  skills,  and  cognitive  psychology  and 
the  study  of  psycho-linguistic  processes  were 
rapidly  expanding.   Also  a  methodological  turning 
point  occurred  in  writing  research.   Prior  to  the 
1970s,  experimental  research  dominated  the  writing 
field.   Its  quantitative  emphasis  tended  to  bind 
researchers  to  the  study  of  written  products 

(Humes,  1983) .   Marrying  other  methodologies  (such 
as  case  studies  and  naturalistic  inquiry)  with  the 
ever-growing  interest  in  cognition  probably  both 
engendered  and  allowed  more  research  on  the  process 
of  writing.   (p.  482) 

State-of-the-art  thinking  about  writing  before  the 
emergence  of  the  kind  of  research  activity  Fitzgerald  was 
referring  to  was  represented  by  Rohman  and  Wlecke's  (1964) 
three-part  stage  model  of  the  composing  process.   This  model 
defined  writing  as  a  linear  process  including  prewriting, 
writing,  and  rewriting. 

The  beginning  of  the  assault  on  this  view  of  the 

composing  process  was  Emig's  The  Composing  Processes  of 

Twelfth  Graders  (1971) .   Emig  found  that  the  discrete-stage 

model  of  the  composing  process  was  incongruent  with  data  she 

had  collected  from  professional  writers.   In  Emig's  words. 

Clearly,  for  these  authors,  the  so-called  "stages" 
of  writing  are  not  fixed  in  an  inexorable  sequence. 
Rather,  they  occur  and  reoccur  throughout  the       ^,  .•. 
process.   These  data  then  make  suspect  the  straight  ' 
line  which  rhetoric  texts  imply  as  an  appropriate 
metaphor  for  the  writing  process.   (p.  25) 
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From  her  observation  of  8  high  school  students  as  they 
composed  aloud,  Emig  was  able  to  construct  the  following  six- 
part  model  of  the  writing  process:   the  stimulus,  prewriting 
and  planning,  the  moment  of  starting,  reformulation  (her  term 
for  revision) ,  the  moment  of  stopping,  and  contemplation  of 
the  product.   Although  Emig  distinctly  introduced  the  concept 
of  recursion  when  describing  what  she  had  learned  from  her 
study  of  professional  writers,  she  characterized  only  the 
element  of  planning  as  recursive  in  her  model  of  the  writing 
process.   Emig  divided  revision  into  three  activities — 
correcting,  revising,  and  rewriting — but  did  not  discuss  how 
revision  may  operate  recursively  in  the  writing  process.   As 
research  into  writing  proceeded,  the  concept  of  recursiveness 
in  the  writing  process  was  more  fully  articulated. 

Using  Emig's  composing-aloud  methodology.  Flower  and 
Hayes  (1980)  took  what  Emig  had  characterized  as  essentially 
an  external,  mostly  linear,  observable  process  and  began 
making  inferences  about  the  nature  of  the  internal,  fully 
recursive,  and  unobservable  cognitive  processes  which  enable 
human  beings  to  produce  written  texts .   Borrowing  from 
information-processing  theory.  Flower  and  Hayes  and  their 
associates  developed  a  convincing  model  of  how  the  brain  may 
operate  as  it  goes  about  the  work  of  creating  written 
discourse.   The  main  cognitive  processes  within  the  Flower 
and  Hayes  model  were  planning,  translating  (i.e.,  text 
creation  on  paper),  and  reviewing.   This  model  of  the  writing 
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process  characterized  all  these  subprocesses  as  recursive, 
not  essentially  linear  as  in  the  earlier  models  of  Emig 
(1971)  or  Rohman  and  Wlecke  (1964),   Flower  and  Hayes 
accounted  for  the  recursiveness  of  the  writing  process  by 
introducing  what  they  called  the  "monitor"  function.   This 
function  may  be  thought  of  as  a  source  of  executive  control 
over  the  whole  writing  process.   As  will  be  shown  below,   ' 
several  writing  researchers  have  explored  this  function  and 
found  it  to  be  an  indispensable  feature  in  the  writing 
process  of  successful  writers. 

Revision,  according  to  the  Flower  and  Hayes  model  of 
composing,  is  a  result  of  a  mismatch,  perceived  by  the 
reviewing  process  posited  in  the  model,  between  existing  text 
produced  by  the  writer  and  the  goals  established  by  the 
writer  for  the  text .   When  the  writer  perceives  such  a     .'.: 
mismatch,  the  editing  function  may  be  activated,  following  v 
which  the  text  is  changed  to  bring  it  into  line  with 
established  goals,  or  the  goals  are  changed  to  bring  them 
into  line  with  the  existing  text. 

Nold  (1982)  developed  a  model  of  composing  that    .  '- 
complemented  the  Flower  and  Hayes  model  by  delineating  the 
kinds  of  concerns  the  monitor  function  attends  to  when  text 
is  reviewed  and  evaluated.   Nold  divided  the  "complex  task" 
(p.  13)  of  writing  into  the  10  subtasks :   motor,  graphical, 
usage,  lexical,  syntactic,  formal,  generic,  rhetorical, 
topical,  and  purposive.   The  motor  subtask  was  related  to  the 
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forming  of  letters  with  a  pen,  typewriter,  word  processor,  or 
some  other  writing  implement.   The  graphical  subtask  involved 
attention  paid  to  such  concerns  as  spelling  and  punctuation. 
The  usage  subtask  included  attending  to  the  requirements  of 
written  language  as  opposed  to  spoken  language,  e.g.,  the  use 
of  complete  sentences  to  express  thought  in  written  language. 
The  lexical  subtask  corresponded  to  the  writer's  choice  of 
individual  words  to  express  thought.   The  syntactic  subtask 
was  the  construction  of  sentences,  including  considerations 
of  how  and  when  to  embed  subsentence  structures  within 
sentences.   Daiute  (1981)  observed  that  this  subtask  is 
sometimes  made  more  difficult  by  the  natural  tendency  of  the 
mind  to  translate  syntactic  structures  into  semantic  ones. 
Nold's  formal  subtask  required  the  writer  to  make  choices 
regarding  the  paragraphing,  sectioning,  or  arrangement  of  the 
text  on  paper,  including  the  choice  of  appropriate 
transitional  expressions  and  cohesive  devices  (Halliday  & 
Hasan,  1976) .   The  generic  subtask  was  related  to  the 
application  of  knowledge  about  the  requirements  of  particular 
forms  of  writing  (e.g.,  newspaper  articles,  limericks)  as  new 
text  is  being  written.   The  rhetorical  subtask  included 
considerations  of  the  needs  of  the  audience.   Flower  (1979) 
pointed  out  that  writers  may  fail  to  carry  out  this  subtask 
successfully  because  their  rhetorical  stance  is  too 
egocentric,  or  "writer-based,"  as  she  terms  it.   The  topical 
subtask  involved  decisions  made  by  the  writer  concerning  the 
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inclusion  or  exclusion  of  information  in  text;  in  other 
words,  decisions  about  the  relevance  of  certain  information 
vis-a-vis  the  emerging  text.   Finally,  the  purposive  subtask 
required  the  writer  to  formulate  a  reason  for  initiating  the 
act  of  writing  in  the  first  place. 

Nold's  model  of  writing  is  important  because  it  adds  an 
entire  dimension  which  is  only  implied,  not  explicitly 
represented,  in  the  Flower  and  Hayes  model.   Although  the 
Flower  and  Hayes  model  is  a  great  improvement  over  those 
which  preceded  it,  one  still  is  led  to  believe  by  the  Flower 
and  Hayes  model  that  writing  is  a  simpler  process  than  it 
really  is.   In  the  Flower  and  Hayes  model,  events  happen  in 
linear  sequence.   Planning  is  followed  by  translating,  which 
is  followed  by  reviewing,  although  each  may  be  interrupted  by 
either  of  the  other  two.   Nold's  model  nicely  complements  the 
Flower  and  Hayes  model.   If  one  superimposes  the  Nold  model 
on  the  Flower  and  Hayes  model,  then  writing  becomes  not  a 
sequential,  linear  cognitive  process  in  which  one  thing 
happens  at  a  time,  but  a  more  precarious  process  in  which 
gridlocks  and  log-jams  are  constant  sources  of  potential 
breakdowns.   The  10  hierarchical  subtasks  simultaneously 
compete  for  the  writer's  limited  attention  at  every  turn  from 
planning,  through  translating,  and  on  to  reviewing.   This 
more  complex  representation  of  the  writing  process,  merging 
Nold's  insights  with  those  of  Flower  and  Hayes,  is  more 
convincing  than  either  of  the  two  models  taken  alone. 
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Elbow  (1987)  questioned  Flower's  categorical  admonitions 
against  egocentric,  "writer-based"  prose,  and  her  contention 
that  writers  should  strive  to  produce  only  "reader-based" 
prose.   Elbow  argued  that  too  much  attention  to  audience 
needs  can  stymie  a  writer's  efforts  to  create  new  meanings. 
In  place  of  Flower's  conception  of  "writer-based"  and  "reader- 
based"  writing  as  necessarily  "bad"  and  "good"  writing, 
respectively.  Elbow  posited  the  need  for  writers  to  dismiss 
considerations  of  audience  during  the  earlier  stages  of 
writing,  in  order  to  pay  more  attention  to  their  own  thinking 
about  their  subjects.   According  to  Elbow,  the  "reader-based" 
prose  called  for  by  Flower  may  best  be  attained  only  after 
"writer-based"  prose  is  brought  through  revision,  at  which 
time  the  writer's  attention  shifts  to  audience  needs. 

Nold  (1982)  asserted  that  there  are  "two  kinds  of 
revising:   revising  to  fit  conventions  and  revising  to  fit 
intentions"  (p.  18) .   Convention-based  revising  is  often 
referred  to  as  proofreading.   Murray  (1982)  called  this  type 
of  revising  "external";  Faigley  and  Witte  (1981)  referred  to 
it  as  "surface."   Intention-based  revising  is  far  more 
complex,  since  writers  must  evaluate  their  own  writing  not 
against  accepted  rules  and  norms  but  against  their  own  sense 
of  what  they  are  trying  to  accomplish  with  their  writing. 
Murray  (1982)  called  this  type  of  revising  "internal";        - 
Faigley  and  Witte  (1981)  referred  to  it  as  "text-based." 
Again,  merging  the  Nold  conception  of  revising  with  that  of 
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Flower  and  Hayes  produces  an  improved  representation  of  this 
aspect  of  writing.   Flower  and  Hayes  have  constructed  a 
plausible  working  model  of  how  the  mind  operates  as  text  is 
being  produced,  and  Nold  has  contributed  a  convincing 
taxonomy  of  the  numerous  demands  that  the  act  of  writing 
makes  on  the  mind. 

Other  researchers  constructed  models  of  the  writing 
process  which  share  important  features  in  common  with  the 
Flower-Hayes  and  Nold  models.   Britton  et  al .  (1975)  gave  the 
names  "conception,  incubation,  and  production"  (p.  22)  to 
what  they  considered  to  be  the  most  important  subprocesses  of 
writing.   Such  a  conception  emphasized  what  Flower  and  Hayes 
referred  to  as  planning  but  did  not  adequately  account  for 
revision  as  part  of  the  writing  process.   Murray  (1978)  gave 
the  names  "prevision,  vision,  and  revision"  (p.  86)  to  the 
processes  Flower  and  Hayes  called  planning,  translating,  and 
reviewing.   Scardamalia,  Bereiter,  and  Goelman  (1982)  used 
the  verbs  "compare,  diagnose,  operate"  (p.  67)  to  label  the 
subprocesses  they  inferred  to  be  at  work  within  the  process 
Flower  and  Hayes  called  reviewing.   Witte  (1987)  chose  to 
name  the  planning  process  of  Flower  and  Hayes  "pretext"  and 
has  called  for  concerted  research  into  this  important  but 
elusive  component  of  the  writing  process. 

Adding  to  these  models  of  how  the  mind  functions  during 
the  production  of  written  text,  Daiute  (1981)  offered  an 
explanation  of  breakdowns  (errors)  in  written  discourse. 


> 


■■,,* 


17 

based  on  psycholinguistic  theory,  especially  the  work  of 
Kahneman  (1973,  cited  in  Reed,  1982)  on  the  allocation  of        '■'''■'. 
limited  cognitive  capacity.   According  to  Daiute,  the  limited      ', 
capacity  of  short-term  memory  places  considerable  constraints    ..  ■ 
on  a  writer  as  he  or  she  generates  ideas,  formulates  Vv 

propositions,  accesses  lexical  items,  plans  clauses  and 
sentences,  translates  from  semantic  to  orthographic 
representations,  and  anticipates  forthcoming  units  of  text 
(Daiute,  1981,  p.  9) .   Daiute  showed  that  many  types  of  ; 

errors  in  written  texts  are  explainable  in  terms  of  an 
overextended  short-term  memory  attempting  to  juggle  an 
overflow  of  information.   Similarly,  de  Beaugrande  (1984) 
characterized  this  predicament  of  a  limited  short-term  memory    , -  \ 
trying  to  cope  with  the  multifarious  demands  of  text  -- 

production  as  a  case  of  simultaneous  and  hierarchical 

4 

elements  of  discourse-creation  being  forced  through  an 

inadequate  funnel  into  linear  and  time-ordered  orthographic        ' 

representations. 

Flower  (1988)  called  for  a  breaking  of  the  longstanding 
taboo,  established  by  the  New  Critics  in  literary  studies, 
against  considering  a  writer's  intentions  when  analyzing 
a  text.   She  argued,  "Writing,  as  a  rhetorical  act,  is  ';• 

carried  out  within  a  web  of  purpose"  (p.  537) .   Her  ongoing 
research  into  the  cognitive  processes  of  writers  revealed 
that  often  writers  begin  writing  without  a  clearly  defined       "   " 
purpose : 
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Writers  at  work  do  not  decide  on  "their  purpose"  as  ■ 
the  textbooks  advise;  they  create  a  web  of 
purposes.   They  set  goals,  toss  up  possibilities. 
They  may  respond  to  one  of  those  ideas  with  a 
negative  evaluation,  which  can  lead  to  new  criteria 
for  what  they  have  to  do,  if  only  they  could  figure 
out  how  to  do  it.   They  think  through  possible 
content  and  leap  back  into  goal  setting,  generating 
provisional,  tentative  ideas  of  what  they  want  to 
achieve,  working  hypotheses  that  they  may  soon 
ditch  or  even  forget.   They  worry  over  questions 
("Do  I  want  .  .  .  ?"),  confusions,  and  conflicts  as 
a  workable  plan  or  cherished  goal  seems  at 
loggerheads  with  other  goals  or  a  piece  of  text 
they  don't  want  to  throw  away.   They  create  a  multi- 
dimensional network  of  information — a  web  that 
radiates  in  all  directions,  anchored  to  points 
unknown.   (p.  531) 

The  chief  differences  between  the  networks  apparent  in 
the  compose-aloud  protocols  of  expert  and  inexperienced 
writers  collected  by  Flower  were  that  those  developed  by 
expert  writers  were  more  elaborate  and  flexible,  allowing  for 
the  reorganization  of  the  whole  for  the  purpose  of  attaining 
a  new  goal  established  to  replace  unworkable  or  preliminary 
goals.   Inexperienced  writers,  in  contrast,  rarely  abandoned 
initial  goals,  and  worked  from  more  skeletal  networks,  often 
resulting  in  writing  which  seemed  forced  or  disjointed. 

Murray  (1978)  suggested  that  with  sufficient  practice  a 
writer  can  automatize  many  of  the  subtasks  involved  in 
writing  after  which  "some  pieces  of  writing  come  easily"  (p. 
92) .   To  help  students  achieve  control  over  their  own  writing 
processes,  to  experience  the  automat icity  with  which  an 
expert  writer  is  able  to  satisfy  the  complex  demands  involved 
in  writing  coherent,  engaging  prose  is  the  challenge  facing 
'^^[f      ^^y   composition  instructor.   The  improved  understanding  of 
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what  the  task  of  writing  entails  which  has  emerged  over  the 
last  20  years  will  help  writing  instructors  meet  that 
challenge.   The  next  section  of  this  literature  review 
contains  a  discussion  of  scholarly  writing  regarding  how 
revision  operates  in  practice. 

Revision  in  the  Writing  of  Composition  Students 

In  a  1959  study  cited  in  Braddock,  Lloyd-Jones,  and 
Schoer  (1963),  Buxton  compared  the  effects  of  three 
experimental  treatment  conditions  on  the  writing  ability  of 
freshmen  at  the  University  of  Alberta.   In  the  control 
condition,  students  merely  completed  the  courses  comprising  a 
teacher-preparation  program  lasting  7  months.   In  the  first 
treatment  condition,  students  enrolled  in  the  same 
instructional  program  wrote  weekly  500-word  essays  in 
addition  to  their  normal  coursework.   These  students  received 
minimal  guidance  regarding  topic  selection  or  how  to  develop 
their  essays  and  received  only  positive,  encouraging  feedback 
from  instructors.   No  revision  of  their  essays  was  required. 
In  the  second  treatment  condition,  students  were  expected  to 
write  on  assigned  topics  "and  to  include  some  critical 
thinking,  a  central  idea,  and  material  that  was  organized  and 
developed"  (Braddock,  Lloyd- Jones,  &  Schoer,  p.  61) .   The 
essays  of  the  second  treatment  group  were  graded  for  content, 
organization,  and  correctness  before  being  returned  to  the 
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students,  who  were  then  given  one  SO-minute  class  period  to 
"correct  the  errors  indicated  on  their  papers"  (p.  61) . 

Using  an  evaluation  form  which  assigned  points  for  the 
quality  of  features,  such  as  title,  diction,  logical 
sequencing,  and  the  effectiveness  of  the  conclusion,  two 
raters  assigned  scores  to  pretest  and  posttest  essays  written 
by  the  257  subjects.   These  raters  achieved  .91  and  .88 
reliability  coefficients  on  their  pretest  and  posttest 
scoring,  respectively.   Buxton  found  that  his  revision  group 
significantly  outperformed  both  the  writing  and  the  control 
groups  in  terms  of  overall  essay  quality  and  several  of  the 
subcategories  in  the  scoring  instrument.   On  the  basis  of 
Buxton's  results,  Braddock,  Lloyd-Jones,  and  Schoer  (1963) 
drew  the  following  conclusion: 

College  freshmen  whose  writing  is  graded  and 
thoroughly  marked  and  criticized  and  who  revise 
their  papers  in  light  of  these  matters  can  improve 
their  writing  more  than  college  freshmen  whose 
writing  receives  a  few  general  suggestions  and  no 
grades  or  intensive  marking  and  who  do  not  revise 
their  papers.   (It  is  not  clear,  however,  what  the 
relative  influence  is  of  each  of  these  three 
factors.)   (p.  70) 

Unfortunately,  as  the  parenthetical  statement  above 

points  out,  Buxton  did  not  control  his  variables  sufficiently 

to  support  any  inferences  about  the  effects  of  revision  alone 

on  the  quality  of  writing.   However,  since  revision  was  an 

important  component  of  the  significantly  more  successful 

treatment  method  in  this  study,  Buxton's  findings  may  be 
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regarded  as  providing  experimental  support  for  including 
revision  as  part  of  writing  instruction. 

A  follow-up  to  the  Buxton  study  was  carried  out  by 
Effros  (1973)  using  10  intact  sections  of  freshman 
composition.   Each  of  five  instructors  taught  one 
experimental  section,  which  included  guided  revisions  of  .■ ' 
students'  essays  with  grades  delayed  until  revision  was 
completed,  and  one  control  section,  which  included  only 
incidental  revision  and  immediate  grades  after  the  first 
drafts  were  completed.   Effros  used  two  instruments  to 
measure  for  differences  between  the  two  treatments.   The 
first  was  the  English  Expression  Test  (Educational  Testing 
Service, 1960) ,  and  the  other  was  the  essay-rating  scale 
developed  by  Buxton,   The  Buxton  scale  was  used  by  two  raters 
to  evaluate  pretest  and  posttest  essays  written  in  class  by 
all  the  students  participating  in  the  study. 

Effros'  results  did  not  support  Buxton's.   On  the     ' '; 
English  Expression  Test,  the  control  sections  significantly 
outperformed  the  experimental  sections.   The  pre-post  essay 
scoring  produced  no  significant  differences  between  the  two 
treatments.   However,  these  results  were  called  into  question 
by  Effros  on  the  basis  of  strong  interactive  effects  in  her 
statistical  analysis,  especially  between  instructor  and 
treatment  (Effros,  1973,  p.  17)  .   Effros  also  reported  that  -- 
posttest  scores  were  sometimes  lower  than  pretest  scores.   In 
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teaching  or  different  predispositions  of  the  classes  is 

difficult  to  surmise  from  the  results"  (p.  20) .   Moreover, 

Effros  noted  large  differences  in  the  pretest  scores  from 

section  to  section,  a  condition  which  also  confounded  her 

findings.   Finally,  Effros  pointed  out  another  failing  in  her 

research  design: 

Judging  the  effects  of  revising  and  rewriting 
themes  that  were  written  at  home  without  the 
pressure  of  time,  and  revised  under  the  same 
conditions,  by  the  results  of  an  essay  written  in 
class  under  the  pressure  of  test  conditions,  may     " 
also  be  questionable.   (p.  21)  '   •.' , 

The  main  thrust  of  Emig's  (1971)  study  amounted  to  a    v 
scathing  and  still  quite  accurate  indictment  of  the        ' 
uninspired  manner  in  which  writing  instruction  is  carried  out 
in  our  schools.   Emig  observed  that  her  8  subjects  took 
little  or  no  time  to  plan  what  they  wrote;  in  other  words, 
they  engaged  in  almost  none  of  the  pre-text  revision  that 
Witte  (1987)  claimed  is  an  essential  feature  of  composing. 
The  reason  Emig's  subjects  took  little  or  no  time  to  plan 
what  they  wrote  is  that  little  or  no  time  was  built  into  in- 
class  writing  assignments  at  their  school.   The  students 
tended  to  compose  algorithmic  essays,  the  kind  a  computer 
might  be  programmed  to  write,  devoid  of  any  commitment  to  the 
exploration  of  ideas  or  to  taking  risks  in  the  name  of 
learning  to  write  well  (p.  82).   Moreover,  none  of  Emig's 
subjects  engaged  in  any  serious  revision  of  their  writing  (p. 
87) .   The  students  merely  submitted  their  first  drafts 
instead  of  whatever  flowed  from  their  pens  as  finished 
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products  and  showed  little  or  no  satisfaction  or  excitement 
about  their  work  (p.  87) .   They  did  not  stop  to  contemplate 
what  they  wrote  and  were  indifferent  to  what  their  writing 
might  say  about  who  they  were  or  the  effects  that  their 
writing  might  have  on  an  audience. 

Emig's  1971  finding  that  students  do  not  typically 
revise  what  they  write  is  consistent  with  other  results 
(Applebee,  1984;  Applebee  et  al.,  1981;  Hoetker  &  Brossell, 
1979;  National  Assessment  of  Educational  Progress,  1977, 
1986;  Pianko,  1977)  which  show  that  since  Emig's  study  little 
has  changed  in  the  way  that  writing  is  taught.   Writing  15 
years  after  Emig,  Gere  (1986)  pointed  out  that  composition 
instruction  still  lacked  a  coherent  philosophy  to  guide  it, 
resulting  in  what  she  called  "the  dominance  of  mechanical 
features  (syntax,  spelling,  modes,  style,  and  punctuation)  in 
today's  instruction"  (p.  34) . 

It  is  important  to  keep  in  mind,  as  one  reviews  the 
literature  on  composing,  that  studies  such  as  Buxton's,  which 
tested  methods  for  teaching  composition  including  a  fully 
articulated  revision  component,  amount  to  research  into  what 
might  happen  in  schools  and  not  into  what  typically  is. 
happening  there.   This  well-documented  gap  between  theory  and 
practice  may  explain  why,  as  Hillocks  (1986)  has  shown,  so 
little  research  has  been  conducted  that  directly  examines 
what  happens  when  students  revise  their  writing.   Researchers 
continue  to  have  difficulty  finding  and  gaining  entry  into 
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environments  where  revision  is  going  on.   The  lack  of     -'- ' 
available  research  settings  has  been  a  serious  obstacle  to 
composition  research.   Lacking  natural  settings  where 
students  regularly  revise  written  work,  researchers  have 
looked  for  differences  between  more  successful  and  less 
successful  writers  in  an  attempt  to  tease  out  the  distinctive 
features  characterizing  these  two  groups . 

It  was  not  until  Sommers  (1978)  wrote  her  dissertation 
that  revision  itself  became  the  focus  of  a  major  study. 
Unlike  Buxton,  Sommers  was  not  interested  in  comparing  the 
effects  of  revision  against  no  revision  in  the  composition 
classroom.   Instead,  she  examined  differences  between  the 
revising  practices  of  competent  and  novice  writers.   Sommers 
analyzed  an  extensive  corpus  of  revisions  made  by  20  college 
freshmen  and  20  experienced  professional  writers  and 
interviewed  them  all  about  their  writing.   She  found  many 
differences  between  the  revising  practices  of  the  two  groups. 
For  example,  Sommers  found  that  the  inexperienced  writers 
tended  to  equate  revision  with  single-word  replacements  in 
their  texts  (p.  84)  and  did  not  think  of  revision  as  a 
process  by  which  complete  texts  may  be  reshaped  (p.  89) . 
Moreover,  the  inexperienced  writers  governed  their  writing  by 
questionable  "rules  for  revision"  such  as  "never  end  a 
sentence  with  a  preposition"  (pp.  86-87)  . 

In  marked  contrast,  the  experienced  writers  in  Sommers' 
study  defined  revision  as  a  recursive  process  of 
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restructuring  text,  of  finding  the  argument,  of  taking  apart 
and  putting  together  again  (pp.  132-134).   They  looked  for  an 
overall  framework  or  design  to  emerge  from  their  rough 
drafts.   In  addition,  unlike  the  freshmen  writers  in  her 
study,  Sommers '  experienced  writers  were  aware  of  an  audience 
for  their  writing  (pp.  138-140),  and  this  awareness  affected 
their  revising  efforts.   Most  important,  the  experienced 
writers  saw  revision  as  a  never-ending  process  operating  at 
all  levels  of  textual  organization  (pp.  140-142). 

Perl  (1978,  1979)  used  a  case-study  approach  to  reveal 
the  composing  processes  of  five  unskilled  writers  in  a 
composition  course  she  was  teaching  at  a  junior  college  in 

;/ V  .   New  York  City.   Perl  reported  on  the  successful  testing-out 
.  /   of  a  research  instrument  she  devised,  composing  style  sheets. 
These  style  sheets  recorded  observable  behavior  subjects 
engaged  in  during  the  act  of  composing  written  texts  and 
''■  ■     included  notations  for  identifying  episodes  of  such 

subprocesses  as  planning,  assessing,  repeating,  reading,  ' 
editing,  and  several  others  (1978,  pp.  54-64). 

'  Perl  found  that  her  subjects  began  writing  after  only  a 

few  minutes  of  prewriting  activity  (p.  311) .   All  five  of  her 
subjects  displayed  consistent  composing  behaviors;  that  is, 
they  all  engaged  in  some  form  of  prewriting,  following  by 

,  >    composing,  interspersed  with  editing  (p.  310) .   Perl  found 
support  for  the  conclusion  that  writing,  even  for  unskilled 

tx-  ,.   writers,  is  a  recursive  process  involving  the  repeated 
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movement  from  a  consideration  of  what  has  been  written  to  the 
production  of  more  writing  to  a  reconsideration  of  what  has 
been  written,  and  so  on  (p.  315) .   This  finding  is  consistent 
with  the  model  of  the  writing  process  constructed  by  Flower 
and  Hayes .  ' 

Regarding  revision,  Perl  reported  that  her  subjects 
often  attempted  to  resolve  complex  problems  of  syntax,  usage, 
and  organization  using  a  set  of  editing  "rules"  which  were 
quite  inadequate  for  achieving  success  in  improving  their 
texts.   Subjects  miscorrected  about  as  many  errors  as  they 
were  able  to  correct  appropriately  (p.  323) .   Furthermore, 
Perl  reported  that  her  subjects  typically  wrote  from  a 
decidedly  egocentric  point  of  view.   In  her  words,  "They  did 
not  see  the  necessity  of  making  their  referents  explicit,  or 
making  the  connections  among  their  ideas  apparent,  or 
carefully  and  explicitly  relating  one  phenomenon  with 
another,  or  of  placing  .  .  .  generalizations  within  an 
orienting,  conceptual  framework"  (p.  32  6) .   She  concluded 
from  this  observation  that  perhaps  unskilled  writers  commit 
too  much  cognitive  capacity  to  editing  as  they  are  composing, 
thus  closing  off  the  flow  of  ideas  and  obscuring  the 
relationships  among  ideas.   To  make  matters  worse,  Perl  found 
that  her  subjects  confined  their  editing  to  the  most 
superficial  levels  of  text.   Not  much  attention  was  paid  by 
Perl's  five  subjects  to  overall  organization  or  the   ' '■ 
development  of  networks  of  ideas  in  their  composing;  they 
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were  more  concerned  with  spelling,  pronoun  use,  and  subject- 
verb  agreement.   Clearly,  Perl's  findings  and  conclusions  are 
in  close  accord  with  those  of  Sommers . 

A  study  by  Faigley  and  Witte  (1981)  measured  the 
differences  in  the  revising  behaviors  of  six  expert  adult 
writers,  six  advanced  composition  students,  and  six 
inexperienced  students  "recruited  from  a  writing  laboratory 
designed  for  students  deficient  in  writing  skills"  (p.  406) . 
Faigley  and  Witte  found  that  82%  of  their  inexperienced 
writers'  revisions  were  surface  changes  which  did  not  affect 
the  meaning  of  their  texts.   The  advanced  composition 
students  and  the  expert  adult  writers,  taken  as  groups,  each 
made  3  times  as  many  meaning-changing  revisions  as  the 
inexperienced  writers,  and  20  times  more  revisions  which 
affected  the  global  structure  of  their  texts.   These  results 
are  consistent  with  the  findings  of  Sommers  and  Perl, 
discussed  above,  and  with  those  of  Bridwell  (1979,  1980),  to 
be  discussed  next. 

An  experimental  study  focusing  on  the  question  of  what 
students  do  when  they  revise  their  essays  was  carried  out  by 
Bridwell  (1979,  1980) .   Bridwell  analyzed  the  revisions  of 
100  twelfth  graders  at  three  stages  in  their  composing 
processes:   during  the  writing  of  first  drafts,  between 
drafts,  and  during  the  writing  of  second  drafts.   Bridwell 
found  that  her  subjects'  revisions,  in  general,  produced 
significant  positive  quality  changes  in  the  direction  of 
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improvement  as  measured  by  Diederich's  (1974)  Analytic  Scale. 
Next,  Bridwell  found  that  there  was  a  strong  correlation 
between  revisions  extending  the  length  of  essays  and  quality 
scores  given  to  those  essays,  implying  that  the  opportunity 
students  had  to  revise  resulted  in  idea-elaboration,  which  in 
turn  improved  the  quality  of  the  writing  in  the  second  drafts 
of  their  essays. 

Consistent  with  findings  reports  by  Sommers  (1980),  Perl 
(1979),  Pianko  (1977),  and  Ramig  (1982),  the  majority  of 
revisions  in  Bridwell 's  sample  occurred  at  the  word,  phrase, 
and  surface  mechanics  levels,  indicating  a  lack  of  attention 
to  whole  discourse  concerns  in  the  revisions  these  students 
made. 

When  Bridwell  analyzed  the  10  essays  rated  highest  and 
the  10  essays  rated  lowest  in  terms  of  quality  (1979,  pp. 
128-134)  she  found  that  the  lowest-rated  essays  had  received 
only  4%  of  the  total  revisions  performed  on  them  at  the 
between-draft  stage.   Ninety-six  percent  of  the  revisions 
made  on  these  10  poorest  essays,  therefore,  were  performed  as 
the  writer  was  producing  new  text .   The  inference  which  can 
be  drawn  from  this  finding  is  that  these  students  did  not 
read  and  contemplate  their  first  drafts  as  much  as  more 
successful  students  did  before  beginning  their  second  drafts. 
The  10  highest-rated  essays  in  Bridwell 's  sample,  in 
contrast,  received  over  29%  of  their  revisions  at  the  between- 
draft  stage,  indicating  that  these  students  did  indeed  read 
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what  they  had  written,  contemplate  the  need  for  revision,  and 
make  improvements  in  their  existing  texts  before  moving  on  to 
the  completion  of  their  second  drafts. 

Audience  Awareness  and  Revision 

Other  researchers  have  explored  the  relationship  between 
awareness  of  audience  and  the  revising  practices  of  student 
writers.   Monahan  (1984),  using  compose-aloud  procedures, 
studied  the  differences  between  four  basic  and  four  competent 
writers  as  they  wrote  essays  for  two  audiences:   their 
teachers  and  their  peers.   He  found  that  both  types  of 
writers  "were  generally  capable  of  the  same  types  of 
revision,  for  the  same  purposes"  (p.  299) .   However, 
^^*  Monahan 's  "basic  writers  [made]  most  of  their  revisions  for 

the  teacher  audience  and  the  competent  writers  [made]  most  of 
their  revisions  for  the  peer  audience"  (p.  300) .   In 
addition,  Monahan  found  that  the  competent  writers  made  more 
revisions,  a  wider  range  of  revisions,  and  longer  revisions 
than  the  basic  writers. 

Roen  and  Willey  (1988)  also  explored  the  relationship 
between  audience  awareness  and  students'  composing  processes, 
including  revision.   Specifically,  these  researchers  studied 
the  effects  of  giving  one  group  of  freshmen  composition 
students  a  set  of  questions  designed  to  prompt  thinking  about 
audience  before  they  began  drafting  an  essay  which  they  later 
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questions  after  they  had  completed  the  first  draft  of  an 

essay.   Twenty  students  were  randomly  assigned  to  each  of 

these  treatment  conditions,   A  third  group  of  20  students 

received  no  questions  as  they  wrote  and  revised  their  essays. 

Following  holistic  scoring  of  the  essays  by  two  trained 

raters  using  a  6-point  scale,  Roen  and  Willey  found  that 

students  who  were  asked  to  focus  attention  on    ■ 
audience,  either  as  they  drafted  or  as  they 
revised,  produced  revised  versions  that  were  judged 
significantly  higher  in  overall  quality  than 
revised  versions  produced  by  students  who  were  not 
asked  to  focus  attention  on  audience.   (p.  82) 

Furthermore,  they  found  no  significant  difference  between  the 

quality  of  revised  essays  written  by  students  in  the 

questions-before-drafting  and  the  questions-after-drafting 

conditions . 

Other  Revision  .qtudies 

Bernhardt  (1988)  investigated  the  effects  of  time-delay 
on  revising.   He  found  that  42  of  117  college  freshmen  basic 
writers,  when  given  3  days  to  do  so  at  home,  were  able  to 
successfully  revise  their  writing  at  all  text  levels. 
Bernhardt  drew  the  conclusion  that  there  is  a  "need  to  be 
cautious  in  generalizing  about  .  .  .  students'  revising 
skills  when  the  conditions  of  testing  severely  constrain  ' 
performance . " 

Gee  (1987)  analyzed  the  work  of  12,695  high  school 
seniors  who  wrote  essays  for  the  Province  of  Alberta's 
English  Written  Composition  Achievement  Test.   He  found  no 
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correlation  between  either  the  kinds  (e.g.,  mechanical, 
lexical,  syntactic,  stylistic,  figurative,  rhetorical)  or  the 
amount  of  revising  done  by  the  students  and  the  resulting 
scores  on  a  4-point  holistic  scale  assigned  to  essays. 
Similarly,  Hillocks  (1986)  found,  in  a  meta-analysis  of 
selected  studies  published  between  1963  and  1982,  no 
statistically  measurable  connection  between  revision,  taken 
by  itself,  and  the  improvement  of  student  writing  (p.  219) . 
However,  Larson  (1987)  and  Schwegler  (1988)  both  strongly 
questioned  the  validity  of  Hillocks'  findings  regarding 
revision.   Schwegler  asserted,  "The  literature  Hillocks 
reviews  on  the  effects  of  revision  ...  is  skimpy  and  not 
clearly  focused"  (p.  452)  . 

Onore  (1983)  questioned  the  wisdom  of  expecting 
improvement  in  texts  as  a  necessary  and  immediate  result  of 
bringing  writing-process-based  pedagogy  to  bear  in  the 
composition  classroom.   Onore  and  two  trained  and  experienced 
readers  working  as  a  committee  applied  "facilitative" 
comments  to  the  first-draft  essays  of  three  college  freshmen. 
Onore 's  study  revealed  that  the  students'  revisions  produced 
as  much  diminution  of  quality  in  subsequent  drafts  as  they 
did  improvement.   Onore  concluded  that  her  students  were  at 
some  points  disrupted  ("exposed  to  chaos")  in  their  composing 
processes  by  the  comments  they  received  from  her.   For  Onore, 
the  relative  quality  of  the  written  product  resulting  from 
instructional  intervention  following  a  first  attempt  at 
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writing  seemed  not  as  important  as  the  development  within 
students  of  the  tacit  understanding  of  what  it  means  to 
compose  effective  written  texts.   Part  of  this  understanding, 
according  to  Onore,  involves  acceptance  of  the  fact  that 
chaos  may  be  an  integral  part  of  the  writing  process. 
Allowing  texts  to  become  chaotic,  and  therefore  less 
successful,  Onore  claimed,  may  be  a  necessary  step  for  some 
students  on  the  road  to  writing  skill.   These  students  need 
to  learn  how  to  call  forth  from  that  chaos  truer,  more 
satisfying  meanings  which  will  contribute  toward  improving 
later  versions  of  their  texts. 

Elaborating  on  this  argument,  Onore  (1989)  called  for  a 
sharing  of  power  between  teachers  and  students  relative  to 
judging  the  quality  of  writing  students  do  for  school,  ,.■. 
including  the  quality  of  their  revisions.   In  her  words,  "In 
traditional  classroom  settings,  the  authority  of  teachers  and 
of  textbook  precepts  prevented  student  writers  from  asserting 
ownership  over  their  writing"  (p.  231).   What  is  needed,  -        :  C^ 
according  to  Onore,  are  classrooms  in  which  students  and 
teachers  negotiate  with  each  other  concerning  the  quality  of 
student  texts  in  such  a  way  "that  neither  pure  idiosyncracy 
nor  tyranny  results"  (p.  232). 

Self-Evaluation  and  the  Writing  nf  :■,   '•  '^^ 

Composition  .qi-ndPnl-5^ 

In  order  for  revision  to  take  place,  writers  must  notice 
a  discrepancy  or  a  "dissonance"  (Bridwell,  1980;  Sommers, 
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1978)  or  "a  mismatch"  (Flower  &  Hayes,  1980)  between  their 
communicative  intentions  and  the  execution  of  those 
intentions  through  the  use  of  language.   This  gap  between 
intentions  and  execution  may  be  perceived  by  the  writer 
before  (Witte,  1987),  during,  or  after  writing  and  may 
correspond  to  one  or  more  of  Nold's  (1982)  10  levels  of 
writing  subtasks.   Unless  students  are  aware,  through  some 
form  of  evaluation,  of  discrepancies  between  their 
communicative  intentions  and  the  degree  of  success  with  which 
they  have  satisfied  those  intentions  via  language,  requiring 
them  to  revise  what  they  write  is  virtually  an  empty 

'l_  ;    exercise,  a  guessing  game  in  which  the  goal  is  to  "give  the 
teacher  what  he  or  she  wants"  (Pianko,  1977,  p,  258)  and  not, 

<:>  '  as  it  should  be,  to  move  a  piece  of  writing  closer  to 

achieving  the  writer's  goals.   A  considerable  amount  of 
research  has  examined  self-evaluation  in  the  writing  process, 
as  the  following  review  will  show. 

Emig  (1971)  revealed  that  her  subject,  Lynn,  engaged  in 
self-evaluation  as  she  composed  aloud  and  that  this  self- 
evaluation  process  was  strongly  influenced  by  a  particular 
teacher's  dictum:   "be  clear,  concise  and  memorable"  (p.  60) . 
Lynn  attempted  "to  translate  [these]  directives  of  high 
abstractness  into  sets  of  behavior  she  [could]  enact"  (p. 
73) .   Her  self-evaluation  resulted  in  decisions  to  retain 
some  written  formulations  and  to  change  others   Out  of  24 
f^::  self-evaluative  comments  made  by  Lynn  during  her  composing- 
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aloud  sessions,  Emig  counted  12  self-accepting,  3  self- 
congratulatory,  1  neutral,  and  8  self-critical  comments  (p. 
64)  .   In  addition,  Emig  found  evidence  that  part  of  Lynn's     . -^ ,  . 
self-evaluation  had  its  source  in  her  awareness  and  concern 
for  her  audience  (p.  64) .   Lynn  also  displayed  an  ability  to 
identify  irrelevant  digressions  in  her  writing  (p.  66) . 

It  is  important  to  note  that  Lynn's  application  of  self- 
evaluation  occurred  exclusively  during  the  creation  of  new 
text.   Emig  pointed  out  (pp.  67-68)  that  her  research  design 
did  not  encourage  subjects  to  revise  after  completion  of  a       ^  .  '* 
first  draft.   However,  Emig  gathered  from  her  observations  of 
and  conversations  with  Lynn  that  this  student  " [had]  a  view 
of  the  writing  process  as  a  no-nonsense,  no-dawdle  task  to     •  .  ■' ,,' 
which  one  devotes  a  given  amount  of  time,  and  no  more"  (p. 
68)  .   Emig  placed  blame  for  this  compartmentalization  of    ,•  ^.   ; 
Lynn's  self-evaluation  process  squarely  on  the  kind  of 
writing  instruction  Lynn  experienced  in  school.   According  to 
Emig,  Lynn's  writing  process  "matches  the  views  of  her 
teachers  who  do  not  provide  school  time  for  the  earlier 
[i.e.,  planning],  and  later  [i.e.,  revising]  portions"  (p. 
73) .   For  Lynn,  revising  a  piece  of  writing  after  the 

■  ,  ia;  ■ . 

completion  of  a  draft  was  "punishment  work"  (p.  68),  ... 

something  which  was  required  only  if  a  piece  of  writing  >'■,' 

suffered  from  too  many  errors.  '■'"^• 

The  other  seven  students  Emig  observed  and  interviewed 
provided  data  which  showed  a  clear  split  between,  on  the  one 
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hand,  their  awareness  of  a  need  for  major  revision  in  their 
writing  (pp.  86-87)  and,  on  the  other  hand,  the  fact  that 
they  "did  no  reformulating"  (i.e.,  revising)  of  pieces 
produced  for  Emig's  inquiry  (p.  87).   No  revising  logically 
implied  that  either  no  self-evaluation  took  place  on  the  part 
of  these  students  or  that  their  self-evaluation  yielded 
complete  satisfaction  with  the  writing  they  had  produced.   On 
the  basis  of  Emig's  comment  that  her  subjects  were  "dutiful 
enough  to  want  to  please — minimally;  no  more,"  one  is  led  to 
conclude  that  no  self-evaluation  took  place  once  these 
students  had  completed  their  first  drafts. 

Moving  beyond  Emig's  exploratory  research,  Stallard 
(1974)  collected  and  analyzed  data  related  to  the  composing 
processes  of  "good"  and  "average"  student  writers  for  the 
purpose  of  systematically  comparing  these  two  groups. 
Stallard  observed  his  subjects,  all  seniors  at  a  Virginia 
high  school,  as  they  composed  essays  about  recent  news  events 
(p.  208) .   After  writing  these  essays,  the  students  were 
interviewed  concerning  their  recollections  of  the  experience 
of  writing  the  essays.   Stallard  found  that  both  groups 
demonstrated  a  concern  for  correct  spelling  and  good 
mechanics.   Moreover,  both  groups  evidenced  a  lack  of  concern 
over  the  issues  of  audience  needs  and  global  essay  structure. 

Stallard' s  "good"  writers,  however,  exhibited  behaviors 
which  were  "peculiar"  (p.  216)  to  them.   They  spent  more  time 
planning  before  writing,  made  more  revisions,  and  revised  at 
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higher  levels  of  syntactic  complexity.   They  more  often  read 
and  thought  about  what  they  were  writing  as  they  composed,       "'-^ 
and  they  more  often  expressed  a  concern  for  having  a  clear 
purpose  for  their  writing  (p.  216) .   In  other  words, 
Stallard's  "good"  writers  engaged  in  more  wide-ranging  self- 
evaluation  of  their  writing  and  sustained  that  engagement 
longer  than  his  randomly  selected  ("average")  group.   These 
differences  between  more  and  less  competent  writers  are 
consistent  with  the  findings  of  Sommers  (1978)  and  Perl 
(1979)  discussed  above.   As  Sommers'  inexperienced  writers 
revised  on  the  basis  of  self-evaluation,  they  made  mostly 
single-word  or  short-phrase  substitutions  (p.  155) .   These 
revisions  were  "dictated  by  their  a-theoretical  [composing]  .• 
process"  (p.  154).   In  sharp  contrast,  Sommers'  experienced 
adult  writers  were  capable  of  self-evaluation  at  all  levels 
of  textual  organization  and  were  sensitive  to  revision  cues 
of  which  her  college  freshmen  writers  were  largely  unaware. 
Similarly,  Perl  (1979)  found  that  her  subjects  were  all  but 
unable  to  evaluate  their  own  writing  beyond  the  word  and 
phrase  levels  and,  like  Sommers'  inexperienced  writers,  were 
heavily  influenced  in  their  self-evaluation  by  attempts  to 
apply  an  unsystematic  set  of  "rules  for  revision"  to  their 
writing.   Perl's  subjects  were  consistently  unable  to 
evaluate  their  own  writing  beyond  these  lower-order,  product- 
based  concerns.   Consistent  with  findings  in  the  studies  of 
Stallard  and  Sommers,  the  inability  of  Perl's  subjects  to 
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revise  effectively  can  be  seen  as  resulting  from  their 
dysfunctional  self-evaluation  processes. 

Beach  (1976)  conducted  an  informal  study  involving  26 
undergraduates  in  a  writing  methods  course.   He  had  them 
write  two  papers  for  which  they  "free  wrote"  (Elbow,  1981)  a 
first  draft  and  then  tape-recorded  their  evaluations  of  that 
first  draft.   The  students  were  allowed  to  write  as  many 
drafts  as  they  wished  but  were  asked  to  tape-record  their 
evaluations  of  each  succeeding  draft.   Beach  found  that  his 
students  fell  neatly  into  two  distinct  groups:   extensive 
revisers  and  nonrevisers .   The  extensive  revisers 
demonstrated  the  kind  of  self-evaluation  process  which 
^  characterized  Stallard's  "good"  writers  and  Sommers' 

experienced  adult  writers.   In  Beach's  words:   "Students  in 
the  extensive  reviser  group  tended  to  conceive  of  revising  as 
a  process  of  making  major  alterations  in  the  content  or 
substance  of  their  drafts"  (p.  161) .   The  nonrevisers,  on  the 
contrary,  "mimicked  formulaic  textbook  language  in  describing 
problems  in  their  drafts.  .  .  .  They  tended  to  conceive  of 
their  problems  in  a  checklist  manner,  noting  each  problem  as 
a  separate  category"  (p.  161).   In  short,  Beach's  nonrevisers 
displayed  characteristics  similar  to  Stallard's,  Sommers', 
and  Perl's  less-able  writers.   They  revised,  when  they 
revised  at  all,  on  the  basis  of  an  a-theoretical,  product- 
oriented  process  of  self-evaluation.   Unfortunately,  Beach 
did  not  reveal  in  this  study  what  his  judgments  were 
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concerning  the  relative  quality  of  the  two  groups'  writing, 
although  one  is  tempted  to  infer  that  the  extensive  revisers 
wrote  better  papers.   It  is  interesting  to  note  that  although 
Beach  has  been  taken  to  task  for  assuming  that  "extensive 
revisers  necessarily  produce  better  quality  paper"  (Faigley, 
Cherry,  Joliffe,  &  Skinner,  1985,  p.  57),  he  did  not  make 
this  claim  anywhere  in  his  1976  article,  focusing  instead  on 
the  differences  between  the  self-evaluation  processes  of  his 
extensive  revisers  and  nonrevisers .   Beach's  expressed 
assumption,  in  his  own  words,  was  "the  fact  that  students 
often  do  not  revise  their  drafts  reflects  their  inability  to 
effectively  evaluate  their  own  writing"  (Beach,  1976,  p. 160). 

A  later  study  by  Beach  (197  9)  compared  the  effects  of 
teacher  evaluation,  student  self-evaluation,  and  no 
evaluation  of  first  drafts  on  the  revisions  10th-  and  11th- 
grade  students  made  on  those  first  drafts.   Beach  controlled 
for  teacher  bias  by  having  a  trained  professional  other  than 
the  classroom  teacher  involved  in  the  study  fill  out  a  four- 
part  essay-evaluation  form  for  the  teacher-evaluation       • 
treatment  group.   Self-evaluators  filled  out  the  same  form 
for  their  own  essays.   The  no-evaluation  group  was  simply 
asked  to  revise  their  first  drafts  before  handing  them  in  for 
grades.   To  measure  the  effects  of  these  three  treatments. 
Beach  employed  three  trained  raters  who  scored  masked  first 
and  final  drafts  using  a  multicategory  3-point  scale  devised 
by  Beach.   The  three  raters  each  read  every  student  essay  and 
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maintained  inter-rater  reliability  above  .84  in  all 
categories  of  the  instrument.   Beach  found  that  the  teacher- 
evaluation  treatment  group  "showed  significantly  higher 
degree-of-change  scores,  fluency  scores,  and  final-draft 
support  ratings  (as  in  "supporting  an  argument  with  examples 
and  logical  reasoning")  than  either  the  self-evaluation  or  no- 
evaluation  subjects"  (p.  117) .   However,  since  Beach  did  not 
include  any  peer-evaluation  treatment  in  his  experimental 
design,  his  results  are  limited  in  their  scope,  indicating 
only  that  teachers'  evaluations  of  students'  writing  may  be 
more  effective  than  students'  evaluations  of  their  own 
writing;  his  results  cannot  indicate  how  peer  evaluation 
might  fare  in  comparison  with  the  other  treatments. 
Miller  (1982),  in  an  informal  study  comparing 
professional  and  student  writers,  discovered  major 
differences  in  the  way  these  groups  evaluated  their  own 
writing.   First,  students  "thought  of  good  writing  as  writing 
the  teacher  liked"  (p.  179) .   Professional  writers,  in  sharp 
contrast,  "experienced  the  quality  of  a  piece  in  relation  to 
how  well  the  finished  product  fulfilled  the  writer's 
intention"  (p.  179) .   Furthermore,  Miller  found  that  her 
professional  writers  "thought  of  their  best  writing  as  the 
one  piece  in  which  they  had  learned  or  mastered  a  particular 
technique  or  had  managed  a  theme  in  a  way  that  had  taught 
them  what  they  meant"  (p.  17  9) .   Again  in  sharp  contrast,  the 
student  writers  rarely  reported  that  they  valued  writing  for 
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the  sake  of  discovery.   Miller's  findings  add  an  important 
dimension  to  this  discussion  of  self-evaluation:   Expert 
writers  apparently  have  internalized  the  criteria  against 
which  they  judge  their  own  writing,  while  students  more 
typically  view  those  criteria  as  external  to  themselves . 

Another  study  related  to  the  issue  of  how  well  students 
assess  the  quality  of  their  own  writing  was  conducted  by 
Matsuhashi  and  Gordon  (1985) .   They  found  that  students  who 
were  directed  to  add  information  to  their  texts  when  those 
texts  were  fresh  in  memory  but  unavailable  for  rereading 
produced  significantly  more  revisions  at  the  whole-text  level 
than  students  who  were  similarly  directed  to  add  information 
with  their  texts  available  for  rereading  or  students  who  were 
directed  simply  to  revise  in  any  way  they  wished  with  their 
texts  available  for  rereading,   Matsuhashi  and  Gordon's 
experimental  subjects  (i.e.,  the  "blind"  ones)  were  forced  by 
their  classroom  situation  to  evaluate  their  texts  as  wholes, 
since  they  could  not  focus  on  the  bits  and  pieces  of  their 
texts  without  rereading.   According  to  Matsuhashi  and  Gordon, 
the  kinds  of  environmental  factors  presented  to  students  by 
their  instructors  makes  a  great  deal  of  difference  in  terms 
of  learning  outcomes.  '" 

Matsuhashi  and  Gordon  drew  a  distinction  between 
instructors'  cues  for  revising  which  elicit  "a  schooled 
response,  a  knowing  that  revision  involves  a  limited  range  of 
surface  structure  manipulations"  (p.  231),  and  cues  for 
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revising  which  elicit  "the  writer's  ability  to  orchestrate 
the  myriad  processes  involved  in  writing  and  revising.   This 
kind  of  knowledge  .  .  .  represents  a  knowing  how^  a  tacit 
ability  to  traverse  the  full  range  of  revisions"  (p.  231) . 
The  results  of  this  study  indicate  that  students  have  more  to 
gain  from  writing  instruction  which  stimulates  the  building 
up  of  tacit  knowledge  about  revision  than  they  do  from 
instruction  which  is  aimed  only  at  building  up  what 
Matsuhashi  and  Gordon  refer  to  as  knowing  that  knowledge  .<.  ': 
This  is  the  same  distinction  underlying  the  revision 
processes  of  the  more  successful  and  less  successful  writers 
studied  by  Stallard,  Sommers,  Beach,  Perl,  and  Miller, 
reviewed  above. 

Beach  (1989)  described  some  of  the  difficulties  students 
encounter  as  they  attempt  to  assess  the  effectiveness  of 
their  own  writing.   First  among  these  difficulties,  according 
to  Beach,  is  the  tendency  of  students  to  terminate  self- 
assessment  as  a  result  of  being  "overwhelmed  or  frustrated  by 
certain  problems  in  their  writing"  (p.  129).   Next,  Beach 
cited  the  fact  that  "students  often  have  an  unclear  sense  of 
their  own  rhetorical  role  or  persona  in  writing  within 
academic  contexts"  (p.  130) .   A  third  problem  inhibiting 
students'  ability  to  engage  in  fruitful  self-assessment  takes 
the  form  of  inflexible  and  often  erroneous  "rules  or  maxims" 
which  they  apply  to  their  writing  (p.  130) .   This  problem  has 
also  been  identified  by  Pianko  (1977),  Perl  (1979),  and 
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Sommers  (1980) .   Another  reason  students  have  difficulty  with 
self-assessment,  according  to  Beach,  is  that  they  skip  an 
essential  step  in  the  self-assessment  process.   They  do  not 
describe  for  themselves  what  they  are  doing  in  their  writing, 
and  leap  ahead  instead  to  make  precipitous  judgments  about 
features  of  the  text  (pp.  134,  135) .   Beach  pointed  out  that 
unless  students  can  describe  their  writing  accurately,  they 
will  have  great  difficulty  judging  how  it  can  be  improved. 
Perhaps  owing  to  these  factors,  students  find  self-assessment 
to  be  an  unhelpful  technique  for  prompting  effective  revision 
(Freedman,  1987)  . 

Peer  Evaluation  and  the  Writing  of 
Composition  Students 

Pierson  (1967)  compared  teacher  evaluation  and  peer 
evaluation  of  ninth-grade  essays  over  a  period  of  8  months. 
Pierson  isolated  the  variable  he  was  interested  in — the 
method  of  evaluating  the  first  drafts  of  essays — by  pairing 
classes  of  similar  students  taught  by  the  same  instructor. 
The  only  difference  between  the  two  groups  taught  by  each  of 
the  three  instructors  was  that  one  group  received 
conventional  teacher  correction  of  first  drafts,  while  the 
other  broke  into  groups  of  four  or  five  students  and  engaged 
in  peer  discussion  of  first  drafts. 

Pierson  used  the  STEP  Writing  Test  to  measure  the  effect 
of  his  treatments  on  the  ability  of  the  students  to  write. 

I.- 

fh.-'\        Pierson  found  no  significant  difference  between  the  two 
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groups  assigned  to  each  of  his  three  instructors,  leading  him 
to  recommend  the  peer  discussion  method  as  preferable  on  the 
grounds  that  it  relieves  instructors  of  many  hours  of  work 
grading  first  drafts. 

The  validity  of  the  STEP  test  employed  by  Pierson  has 
been  called  into  question  in  Euros'  Fifth  Mental  Measurements 
Yearbook  (1959) ,  because  it  requires  no  writing  but  asks 
instead  that  the  test-takers  evaluate  what  others  have 
written.   In  spite  of  this  flaw,  Pierson 's  study  is  still  a 
good  example  of  how  to  set  up  an  experimental  study  of 
writing  in  a  live  school  setting.   Pierson 's  findings  cannot 
be  regarded  as  strong  evidence  in  favor  of  peer  interaction 
as  part  of  composition  instruction,  but,  at  the  same  time, 
they  offer  no  disconf irmation  of  that  method  either. 

Another  experimental  study  comparing  the  effects  of  two 
ways  of  teaching  writing  was  the  basis  for  Lagana ' s  (1972) 
dissertation.   Lagana  used  two  lOth-grade  classes  she  was 
assigned  to  teach  as  the  experimental  environment  for  the 
study.   She  compared  her  self-designed  approach  to 
composition  instruction,  including  the  use  of  individualized 
writing  folders  and  peer-group  discussion  of  student  essays, 
with  the  traditional  method  of  teaching  writing  in  Penn 
Hills,  Pennsylvania,  at  that  time,  a  method  organized  around 
whole-group  instruction,  dittoed  worksheets,  and  teacher 
evaluation  of  student  essays. 
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Lagana,  following  the  example  of  Pierson,  used  the 
STEP  Writing  Test  to  measure  the  effects  of  her  treatments. 
She  reported  that  her  experimental  group,  using  the 
individualized  folders  and  peer  discussion,  significantly 
outperformed  the  traditional  group.   Also,  Lagana  claimed 
that  her  experimental  subjects  emerged  from  that  treatment 
with  a  more  positive  attitude  toward  writing  and  presented  a 
long  list  of  testimonial  statements  from  her  students  to 
support  this  claim.   Moreover,  she  reported  that  her 
experimental  subjects  were  able  to  arrive  at  informal 
"grades"  for  each  other's  work  which  closely  matched  the 
official  grades  she  arrived  at.   Lagana,  in  agreement  with 
Pierson,  found  that  her  paper-correcting  burden  was  greatly 
reduced  for  her  experimental  treatment  class,  an  argument  for 
the  peer-interactive  method  over  the  traditional  approach. 
Unfortunately,  Lagana ' s  study  is  open  to  criticism  concerning 
its  design.   The  fact  that  the  experimenter  was  also  the 
classroom  teacher  is  an  obvious  weakness,  raising  questions 
about  her  objectivity.   Also,  her  use  of  the  STEP  Writing 
Test  somewhat  compromised  the  validity  of  her  findings. 

Benson  (1980)  conducted  a  study  involving  seventh-  and 
eighth-grade  students  to  measure  the  effects  of  three 
experimental  treatments  on  a  variety  of  dependent  variables. 
The  first  of  these  treatments  was  called  "information 
feedback"  (p.  34)  and  involved  peer  interaction  using  a 
highly  structured  evaluation  form  that  students  filled  out 
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for  each  other.   The  second  treatment  was  "reinforcement 


feedback"  and  involved  peer  interaction  using  a  loosely 
structured  evaluative  form  eliciting  such  responses  as 
"favorite  sentence"  and  "favorite  word."   This  treatment 
tended  to  evoke  more  positive,  complimentary  responses  than 
the  information-feedback  form.   The  third  treatment  was  a 
control  group  receiving  no  peer  interaction.   Compared  to  the 
results  of  the  control  group,  both  experimental  treatments 
"achieved  statistical  significance  at  .05  or  beyond  for  five 
dependent  variables:   quality  of  writing,  paragraph  revision, 
sentence  revision,  word  revision,  and  total  revision"  (p. 
iv) .   The  effects  of  the  two  experimental  treatments  were  not 
statistically  significant  in  comparison  with  each  other.   On 
the  basis  of  these  findings,  Benson  recommended  the  use  of 
peer  interaction  as  part  of  composition  instruction. 

Gere  and  Abbott  (1985)  conducted  a  study  to  determine 
what  kinds  of  conversations  take  place  when  peer  groups  meet 
in  composition  classrooms.   These  researchers  recorded  the 
conversations  of  5th-,  8th-,  and  llth-grade  students  who  were 
participating  in  writing  discussion  groups.   Nine  such  groups 
were  involved  in  the  study,  and  each  group  was  recorded  a 
minimum  of  four  times .   The  recordings  were  transcribed, 
after  which  the  students'  conversations  were  divided  into 
idea  units,  following  Chafe  (1980) .   The  idea  units  were 
further  divided  into  categories  on  the  basis  of  the 
linguistic  function  each  one  performed:   informing. 
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directing,  or  eliciting.   The  researchers  were  interested  in 
identifying  the  focus  of  attention  for  each  idea  unit.   They 
counted  the  number  which  were  directed  toward  the  students' 
writing  and  those  which  were  directed  toward  other  issues, 
such  as  how  the  group  was  functioning  or  interpersonal 
relations  between  group  members.   Finally,  the  researchers 
tallied  the  number  of  idea  units  which  focused  on  writing 
processes,  form,  content,  context,  and  reference, 
respectively. 

Gere  and  Abbott  found  that  the  majority  of  the  students' 
idea  units  focused  on  the  students'  writing  and  not  on 
frivolous  or  irrelevant  subjects  of  conversation.   This 
finding  countered  objections  which  may  be  raised  by     - 
instructors  opposed  to  the  use  of  peer  groups  as  part  of 
composition  instruction  on  the  grounds  that  such  peer 
interaction  presents  too  much  temptation  for  students  to 
waste  time  in  social  chatter.   Gere  and  Stevens  (1985), 
working  with  a  different  portion  of  the  data  discussed  by 
Gere  and  Abbott  (1985),  supported  and  reinforced  the  general 
finding  that  students  may  be  expected  to  remain  on  task  when 
they  are  asked  to  meet  in  peer  groups  to  discuss  each  other's 
writing  and  that  the  responses  they  give  each  other  in  these 
groups  is  frequently  more  personally  relevant  and  directly 
related  to  the  texts  they  have  produced  than  is  possible  when 
the  only  audience  is  the  teacher  and  the  only  channel  for 
feedback  is  teacher  marginalia. 
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Additional  evidence  supporting  the  use  of  peer  editing 
groups  as  part  of  composition  instruction  is  provided  by 
Karegianes,  Pascarella,  and  Pflaum  (1980) .   Working  with  low- 
achieving  lOth-grade  students  (the  49  subjects'  mean  grade 
equivalent  score  was  7 . 2  on  the  Gates-MacGinitie  Reading 
Test) ,  the  researchers  presented  the  students  with  well 
organized  writing  instruction  including  the  assignment  of  one 
essay  per  week.   Twenty-six  of  the  students  participated  in 
peer  editing.   They  each  exchanged  essays  with  one  classmate 
and  filled  out  an  editing/rating  form  provided  by  the 
researchers.   The  other  23  students  involved  in  the  study  had 
their  essays  edited  and  rated  by  the  classroom  instructor 
using  the  same  editing/rating  form.   Except  for  this 
variation,  and  the  fact  that  students  in  the  teacher-editing 
treatment  engaged  in  class  discussion  to  balance  the  time 
spent  by  the  peer-editing  students  interacting  with  each 
other,  all  instruction  during  the  10  weeks  of  study  was  kept 
as  identical  as  possible. 

Pretest  and  posttest  essays  in  the  study  were  scored  by 
experienced  English  teachers  using  the  Diederich  analytic 
scale  (Diederich,  1974)  minus  the  dif f icult-to-interpret 
"flavor"  category.   The  raters  achieved  reliability 
coefficients  of  .87  and  .85  for  the  pretest  and  posttest 
essays,  respectively.   A  statistical  analysis  of  these  scores 
revealed  a  significant  difference  favoring  the  peer-edit 
treatment.   Apart  from  the  fact  that  the  peer-edit  essays 
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scored  higher  than  the  teacher-edit  essays,  the  researchers 
argued  in  favor  of  peer  interaction  in  the  composition 
classroom  on  the  basis  of  increased  time-on-task  associated 
with  the  peer-edit  treatment.   They  described  this  effect  as 
follows : 

The  practice  of  peer  editing  itself  may  ... 
stimulate  students  to  an  increased  attention  to  the 
task  of  composition.   (Recall  that  while  the 
teacher-edit  participants  were  engaged  in  asking 
questions  of  the  teacher  concerning  her  editing  of 
their  papers,  participants  in  the  peer-edit  group 
were  intensively  involved  in  evaluating  their 
classmate's  essays  against  the  instructional 
criteria  for  that  lesson.)   Thus,  while  attention 
to  the  task  was  voluntary  by  students  in  the 
teacher-edit  group,  it  was  essentially  mandatory 
for  the  peer-edit  group.   Editing  itself  may,  then,    .  < 
function  as  a  useful  teaching  technique  for 
focusing  and  extending  attention  to  task  and, 
thereby,  providing  an  effective  use  of  classroom 
time.   (p.  206) 

Karegianes,  Pascarella,  and  Pflaum  also  pointed  out  that 

since  their  subjects,  all  inner-city,  low-achieving.  Latino 

students,  experienced  a  significantly  better  outcome  of 

composition  instruction  using  peer  interaction,  arguments 

that  this  type  of  instruction  is  only  applicable  and 

appropriate  for  middle-class,  high-achieving  students  may  not 

be  valid.  .■ 

*-■  .       Taking  another  tack,  Graner  (1987)  conducted  a  study  of 

peer  editing  based  on  the  assumption  that  many  composition 

teachers  are  not  comfortable  with  giving  up  control  of  the 

classroom  in  order  to  allow  peers  to  engage  in  face-to-face 

,•.     discussions  of  their  writing.   Accordingly,  Graner  compared 

&^  '   the  effects  of  peer  evaluation  and  discussion  of  student 


essays  with  the  effects  of  a  treatment  he  called  Revision 
Workshops.   Working  with  two  English  classes  at  a  military 
prep  school,  Graner  had  one  class  engage  in  peer-group 
discussions  of  student  essays,  using  evaluation  forms  which 
asked  students  to  comment  on  issues  ranging  from  correctness 
of  spelling  to  the  overall  structure  of  an  essay.   These 
evaluation  forms  were  tailored  to  the  varying  types  of 
writing  (e.g.,  description,  character  sketch,  process 
analysis)  the  students  were  assigned.   In  the  Revision  ' 
Workshops,  students  did  not  read  and  comment  on  each  other's 
essays,  nor  did  they  meet  in  groups  for  discussion.   Instead, 
they  used  the  same  evaluation  forms  as  did  the  peer  editing 
students  but  applied  them  to  sample  essays  chosen  by  the 
researchers.   These  sample  essays  were  selected  to  show 
important  strengths  and  weaknesses  in  writing  and  to  provide 
the  basis  for  teacher-led,  whole-class  discussions  of  the 
sample  essays. 

Graner  found  that  the  Revision  Workshop  group  and  the 
peer  editing  group  both  improved  significantly  in  writing   ■ 
ability,  based  on  the  differences  between  the  scores  earned 
on  pre-  and  posttest  essays  as  measured  by  Diederich's 
analytic  scale  (Diederich,  1974) .   Importantly,  there  was  no 
significant  difference  between  the  two  groups  in  terms  of 
their  relative  improvement  in  writing  ability.   From  these 
results,  Graner  inferred  that  the  crucial  factor  at  work  in 
his  study  was  feedback  and  that  this  feedback  was  effective 


-^  50 

in  helping  students  improve  their  writing,  regardless  of 

whether  it  came  in  the  form  of  face-to-face  peer  interaction 

or  in  the  form  of  generalized  discussions  of  the  issues 

pertinent  to  the  assignments  these  students  were  working  on. 

Thus,  Graner  concluded  that  his  Revision  Workshop  was  an 

effective  alternative  to  peer  editing  and  recommended  it  to 

instructors  who  wish  to  remain  the  focal  point  of  their 

classrooms. 

In  a  study  whose  findings  ran  somewhat  counter  to 

Graner 's  evidence,  Nystrand  (1986)  compared  the  effects  of 

intensive  peer  review  with  the  effects  of  instruction  in 

writing  at  the  University  of  Wisconsin-Madison  that  did  not 

employ  this  technique.   Nystrand  described  intensive  peer 

review  as  follows: 

Students  .  .  .  meet  regularly  in  groups  of  four  or 
five,  and  the  same  groups  meet  three  times  a  week 
over  the  course  of  the  term  for  the  purpose  of 
sharing  and  critiquing  each  other's  writing.   The 
instructor  assigns  few  if  any  topics  and  gives  the 
students  no  checklists  to  use  in  monitoring  their 
discussion.   Rather,  students  keep  journals  and 
prepare  pieces  of  exposition  from  these  notebooks 
for  presentation  to  classmates  at  every  class 
meeting.   Students  are  required  to  prepare  a  new 
paper  or  a  substantial  revision  for  each  class. 
They  are  instructed  to  consider  the  extent  to 
which  the  author  achieves  his  or  her  purpose;    .  ..' 

■'  they  are  to  avoid  checking  spelling,  punctuation, 
and  usage;  and  they  are  required  to  provide  each 
member  of  their  group  with  a  photocopy  of  their 

.  work.   Periodically  the  instructor  collects  the 
best  papers  from  each  student  for  evaluation, 
but  she  does  relatively  little  direct  instruction, 
and  intervention  in  these  groups  is  minimal.   (p. 
180) 
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Nystrand  collected  essays  from  each  of  250  students  in 
13  classes  and  compared  these  essays  using  a  rating  scale 
derived  from  Britton  et  al .  (1975)  which  differentiated 
writing  along  a  continuum  from  reporting  to  inferencing  to 
generalizing.   The  students  in  the  classes  engaging  in 
intensive  peer  feedback  (the  "studio"  classes)  showed  a 
significantly  larger  increase  in  the  amount  of  inferences  and 
generalizations  in  their  essays  compared  with  students  who 
did  not  take  part  in  peer  feedback  activities  (the 
"nonstudio"  classes) .   Nystrand  also  reported  that  "nonstudio 
students  came  increasingly  to  see  revision  as  a  matter  of 
editing  (i.e.,  attention  to  matters  of  mechanics  and  usage), 
while  studio  students  increasingly  treated  revision  as  a 
matter  of  reconceptualization"  (p.  184) .   Nystrand 's  studio 
students  also  "made  significantly  more  progress  in  the 
development  of  their  writing  abilities"  (p.  184)  as  measured 
by  pre-  and  posttest  scores  on  the  University  of  Wisconsin 
Placement  Test  and  the  College  Qualifying  Test/Verbal. 
Unfortunately,  Nystrand  did  not  discuss  the  nature  of  the 
instruction  provided  for  his  nonstudio  students.   Such  an 
oversight  makes  interpretation  of  Nystrand* s  study  difficult. 

Nystrand  and  Brandt  (1989)  found  in  a  follow-up  to 
Nystrand' s  1986  study  that,  on  the  basis  of  blind  readings  by 
two  trained  graduate  students  using  a  series  of  Likert-type 
scales,  several  differences  existed  between  the  revisions  and 


statements  about  revision  made  by  studio  and  nonstudio     ' 

students : 

First,  studio  students'  revisions  were  of  higher 
quality  than  those  of  their  counterparts.   In 
addition,  studio  and  nonstudio  students  expressed 
very  different  views  of  what  is  required  to 
effectively  revise  their  papers.  .  .  .  (p.  213) 
Studio  students  (1)  had  more  to  say  than  their 
counterparts  about  their  revision  needs,  (2)  were 
more  specific  about  those  needs,  (3)  explained  more 
clearly  what  their  revisions  were  to  accomplish, 
(4)  were  openly  critical  of  their  drafts,  (5)  more 
clearly  particularized  their  revision  needs  to  a 
rhetorical  situation,  and  (6)  discussed  their        '.... 
revision  needs  in  a  more  coherent  and  integrated 
manner.   (p.  215)  '  > v 

The  generally  positive  picture  regarding  the  benefits  to 

be  expected  from  peer  feedback  activities  reflected  in  the 

literature  surveyed  above  has  been  reinforced  by  writers  such 

as  Beaven  (1977),  Bruffee  (1984),  Elbow  (1981),  Flanigan  and 

Menendez  (1980),  Gebhardt  (1980),  Lamberg  (1980),  Macrorie 

(1984),  Moffett  (1986),  and  Murray  (1985).   In  contrast  to 

this  supportive  view  of  peer  feedback  as  an  ingredient  in 

composition  pedagogy,  Diana  George  (1984)  found  that  only 

some  peer  groups  attain  the  kind  of  wished-for  outcomes 

described  by  the  authors  cited  above.   Two  other  kinds  of 

i-v;:   peer  groups,  which  George  named  "leaderless"  and        '   . 

"dysfunctional,"  were  troublesome  by-products  of  the  peer- 

interaction  approach  to  composition  instruction.   These  types 

of  peer  groups  characteristically  engage  in  counterproductive 

interactions  and  did  little  in  the  way  of  helping  their 

members  improve  their  writing,  according  to  George.   In 

agreement  with  this  more  skeptical  view  of  peer  interaction 
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in  the  composition  classroom  is  Newkirk  (1984),  who 
introduced  additional  factors  which  tend  to  erode  the 
effectiveness  of  peer  interaction  as  an  instructional 
approach.   Newkirk  found,  in  a  study  comparing  the  reactions 
of  10  students  and  10  instructors  at  the  University  of  New 
Hampshire  to  student  essays,  that  students  were  far  more 
accepting  of  each  other's  writing  than  their  instructors. 
They  tended  to  read  missing  information  into  their  peers' 
writing  and  to  be  impressed  by  writing  styles  which  were 
rejected  by  instructors  as  inappropriate.   This  kind  of 
ineffective  feedback  on  the  part  of  students,  Newkirk  pointed 
out,  must  be  addressed  by  instructors  who  use  peer 
interaction  with  their  classes. 

Berkenkotter  (1984)  reported  that  the  personalities  of 
students  may  interfere  with  how  well  peer  interaction  helps 
them  improve  their  ability  to  write.   For  example, 
Berkenkotter  found  that  immature,  defensive  types  tended  to 
reject  categorically  good  peer  advice,  while  passive  and 
vulnerable  types  were  more  likely  to  accept  and  act  upon  poor 
peer  advice,  thereby  lowering  the  quality  of  resulting 
writing.   A  fourth  investigator.  Carter  (1982),  found  in  a 
study  which  isolated  peer  interaction  as  a  variable  in  a 
study  of  college-bound  high  school  seniors  that  having  peers 
read  and  comment  on  each  other's  writing  produced  no  better 
results  in  terms  of  writing  quality  compared  with  a  control 
treatment  in  which  no  peer  interaction  was  employed.   Ziv 
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(1983)  found  that  some  college  freshmen  who  participated  in  a 
study  of  peer  evaluation  of  student  writing  resented  critical 
comments  about  their  writing  coming  from  a  source  other  than 
their  instructor  and  ignored  what  may  have  been  good  advice 
because  of  that  resentment. 

Freedman  (1987)  found  that  students  responding  to  a 
national  survey  indicated  that  they  "do  not  find  peer- 
response  groups  very  helpful"  (p.  87).   According  to 
Freedman,  when  students  meet  in  peer-response  groups,  the 
talk  is  often  guided  by  the  students'  desire  to  help  each 
other  "get  their  writing  'right'"  (p.  161);  in  other  words, 
they  try  to  identify  what  their  teacher  wants  in  the  writing, 
instead  of  using  the  peer  group  to  engage  each  other  in 
discussions  of  their  experiences  as  they  read  each  other's 
writing.   The  generally  positive  image  of  peer  feedback  which 
has  been  built  up  in  much  of  the  research  literature  must  be 
considered  in  light  of  these  less  supportive  reports. 

Finally,  in  a  study  of  12th-graders  comparing  peer 
response  and  self-evaluation,  in  which  the  researcher  was 
also  the  cooperating  instructor,  DiMento  (1988)  found  a 
slight  advantage  for  self-evaluation  in  improving  essays  from 
first  to  final  drafts.   However,  neither  approach,  according 
to  DiMento,  was  superior  in  stimulating  improvement  in  essay 
quality  over  a  12-week  period. 

This  review  of  scholarly  literature  has  shown  that,  over 
the  last  20  years,  a  change  has  occurred  in  the  way  educators 


55 

perceive  writing  and  writing  instruction  (Herrington,  1989), 
resulting  in  a  vigorous  and  continuing  effort  on  the  part  of 
researchers  to  learn  more  about  the  details  of  the  writing 
process  and  to  test  the  usefulness  of  instructional 
techniques  that  are  intended  to  promote  better  results  in  our 
schools.   The  complexity  of  the  process  by  which  writing  is 
created  has  been  acknowledged  and  preliminarily  explored. 
The  concept  of  revision  has  been  clarified  so  that  it  is  no 
longer  considered  the  discrete  stage  within  the  writing 
process,  but  a  permeating  factor  that  may  be  activated  on  the 
basis  of  many  cues,  the  nature  of  which  are  still  open  to 
investigation.   The  importance  of  raising  students' 
consciousness  beyond  the  most  superficial  aspects  of  text 
when  they  read  their  own  written  work  has  also  been 
acknowledged,  and  researchers  have  begun  to  explore  ways  of 
reaching  this  instructional  goal. 

The  present  study  was  designed  to  contribute  to  the 
expansion  of  knowledge  about  revision,  self-evaluation,  and 
peer  evaluation  within  the  context  of  composition 
instruction.   Each  of  the  studies  discussed  in  this  review  of 
literature  contained  valuable  insights,  but  some  of  them  were 
weakened  by  problems  in  their  design  or  in  the  methods  of 
measurement  they  employed.   For  example,  Pierson's  (1967)  and 
Lagana's  (1972)  use  of  the  STEP  Test  of  Writing  raised 
questions  about  exactly  which  variables  experimental 
^,;-/:'   treatments  in  those  studies  actually  affected.   The  studies 
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_/frr  -■      by  Perl  (1978)  and  Onore  (1983)  provided  rich  detail  in  their 

■^Z  /n'  examination  of  their  subjects,  but  they  were  weakened  by 

•  ..    questions  about  whether  the  particular  students  involved  in 

»■■■■-- 

,,  _^      these  studies  were  representative  or  atypical.   Moreover, 

-V     since  the  researcher  was  also  the  classroom  instructor  in  the 
.  ..     case  of  Lagana,  Pearl,  and  Onore,  questions  about  the 
■  •   objectivity  of  data  interpretation  cannot  be  entirely 

dismissed.   Bridwell ' s  (1979)  study  contained  important  data 
related  to  the  revising  behavior  of  high  school  students  but 
was  weakened  by  the  fact  that  its  conclusions  were  based  on  a 
r,'  single  piece  of  writing  composed  by  the  100  students  who 
participated. 

The  present  study  has  collected  data  from  40  students, 
has  analyzed  writing  composed  over  a  4-month  period,  and  has 
used  holistic  scoring  to  measure  effects  on  its  dependent 
variables.   In  addition,  the  present  study  has  drawn  data 
from  qualitative  and  quantitative  sources,  demonstrating  how 
these  two  research  methodologies  may  be  used  to  complement 
each  other  within  a  study  of  composing  processes.   While 
attempting  to  overcome  some  of  the  problems  in  the         ■  >•.  ' 
experimental  design  of  existing  studies  of  revision,  self- 
•,  evaluation,  and  peer  evaluation,  this  researcher  tried  to 
\^,  design  a  study  that  would  contribute  toward  a  better 

understanding  of  these  components  of  the  composing  process 
and  of  how  the  particular  instructional  approach  employed  in 
this  study  affected  them. 
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CHAPTER  THREE 
METHODOLOGY 


This  study  was  based  on  data  drawn  from  four  sections  of 
ENC  1101  (Freshman  Composition)  conducted  during  the  fall 
semester  of  1987  at  the  University  of  Florida.   Each  of  two 
instructors  taught  one  self-evaluating  and  one  peer- 
evaluating  section  of  ENC  1101.   All  sections  met  in  the 
morning  for  three  50-minute  periods  per  week  for  14  weeks. 

Selection  of  Instrncfors 

Two  instructors  were  used  in  this  study  in  order  to 
reduce  the  threat  to  validity  which  would  have  resulted  had 
only  one  instructor  been  involved.   However,  no  attempt  was 
made  to  compare  the  data  from  the  two  instructors 
statistically,  because  doing  so  would  have  introduced  many 
uncontrollable  variables,  such  as  differences  between  the 
instructors  in  the  way  they  taught  their  sections .   Instead, 
the  two  instructors  represented  two  separate  environments 
within  which  the  hypotheses  underlying  the  study  could  be 
tested.   This  replication  made  it  possible  to  identify  both 
consistent  and  divergent  results,  leading  to  interesting 
questions  for  further  research  to  resolve. 
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In  the  summer  of  1987,  after  gaining  the  permission  of 
the  English  Department  to  conduct  this  study,  the  researcher 
sought  out  composition  instructors  who  would  be  teaching  two 
sections  of  freshman  composition  in  the  fall.   The  two 
instructors  who  agreed  to  participate  in  this  study  were  both 
experienced  teachers  in  writing.   Instructor  One  was  an 
associate  professor  of  English  with  over  20  years'  experience 
at  the  University  of  Florida.   Instructor  Two  was  a  doctoral 
student  in  the  English  Department  at  the  University  of 
Florida.   She  held  a  B.A.  in  English  from  Columbia  University 
and  a  M.A.  from  Teachers  College,  Columbia.   Her  teaching 
experience  included  10  years  as  an  English  teacher  at  the 
high  school  level  in  Rhode  Island,  Texas,  and  Florida. 

Assignment  of  Suh-iects  to  Treatmpm-.^! 

Random  assignment  of  subjects  to  treatments  was  not 
possible  for  this  study.   Students  were  assigned  to  sections 
by  computer  on  a  first  come,  first  served  basis,  following 
the  normal  registration  process  at  the  University  of  Florida. 
;•  Which  of  each  instructor's  sections  would  receive  the  self- 
evaluation  or  peer-evaluation  treatment  was  decided  by  a  coin 
toss. 

On  the  first  day  of  classes,  students  were  told  that  a 
research  project  had  been  proposed  involving  their  sections 
of  ENC  1101  and  that  their  voluntary  participation  was  being 
solicited.   Eighty  of  the  91  students  enrolled  in  the  four 
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sections  chosen  for  the  study  agreed  to  participate.  Table  1 
shows  the  number  from  each  section  who  volunteered. 

Table  1 

Student  Response  to  Rpgnest  to  Parti ri pate  in  the  Study 


Students    Students  Agreeing 
Section  Enrolled    to  Participate 


Instructor  One,  Self-Evaluating  24  21 

Instructor  One,  Peer-Evaluating  22  20 

Instructor  Two,  Self-Evaluating  23  19 

Instructor  Two,  Peer-Evaluating  22  20 


From  each  section,  10  students  were  randomly  selected  as 
subjects.   Their  identities  were  never  revealed  to  their 
instructors  during  the  study.   Of  these  10  from  each  section, 
4  students  were  again  randomly  selected  for  participation  in 
tape-recorded  interviews  outside  of  class.   Each  of  the 
students  chosen  for  the  interviews  agreed  to  meet  with  the 
researcher  for  3  one-to-one  interviews  spaced  about  1  month 
apart.   Prospective  interviewees  were  contacted  by  telephone; 
their  names  were  not  revealed  to  the  instructors. 

Table  2  displays  the  distribution  of  males  and  females 
in  the  study. 
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Table  2 

Distribution  of  Mal^s  and  Femalps 


Self -Evaluating 
Section 


Peer-Evaluating 
Section 
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Males 

Females 

Males 

Females 

Instructor  Otip 

Total  Volunteers 

12 

12 

12 

9 

Participants 

5 

5 

7 

3 

Interviewees 

2 

2 

3 

1 

Instructor  Two 

Total  Volunteers 

12 

11 

7 

15 

Participants 

5 

5 

3 

7 

Interviewees 

1 

3 

2 

2 

"..^■ 


A  questionnaire  filled  out  by  83  of  the  91  students  in 
the  four  sections  revealed  that  these  classes  were  fairly 
homogeneous  from  a  demographic  point  of  view.   For  example, 
70  of  the  83  had  graduated  in  the  summer  of  1987  from  Florida 
high  schools.   All  of  the  40  students  randomly  selected  for 
the  study  were  between  17  and  20  years  old,  and  all  had 

■  graduated  from  high  school  in  the  summer  of  1987.   Thirty- 
eight  of  the  40  were  residents  of  Florida,  and  two  were  from 

.,  New  York  State. 
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Classroom  Pror,pdnrf>s 

There  were  many  differences  between  the  two  instructors 
in  the  way  they  usually  taught  their  sections  of  ENC  1101. 
However,  each  instructor  taught  the  two  sections  assigned  to 
her  for  this  study  as  similarly  as  possible.   For  example,  in 
her  two  sections  each  instructor  used  the  same  textbook,  set 
the  same  assignments,  commented  on  student  work  in  the  same 
way,  and  followed  the  same  syllabus. 

For  the  first  essay  assignment.  Instructor  One  asked  for 
a  response  to  the  statement,  "All  writers  sell  the  reader 
short . "   Instructor  Two,  on  the  other  hand,  asked  her 
students  to  compose  a  hypothetical  job  application  letter  and 
resume.   Following  the  first  writing  assignment,  both 
instructors  organized  their  essay  assignments  according  to 
the  "modes  of  discourse"  approach  and  agreed  with  each  other, 
independent  of  any  input  from  the  researcher,  to  follow  the 
same  order  of  assignments.   As  a  result,  all  students  in  all 
sections  wrote  their  second  through  seventh  (final)  essays 
conforming  to  the  following  modes  of  discourse  and  in  the 
following  order:   personal  narrative,  process  analysis, 
definition,  classification,  cause/effect,  and  argumentation. 

Students  in  all  sections  completed  essay  assignments 
according  to  a  four-step  procedure  established  to  promote 
equal  application  of  treatments  across  groups.   Figure  1 
indicates  how  this  four-step  procedure  operated. 
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Some  clarification  is  necessary  concerning  the  timing  of 
the  steps  and  the  nature  of  the  revision  guides  mentioned  in 
Figure  1.   Step  2  always  commenced  one  week  following  Step  1. 
Step  3  always  commenced  two  class  periods  following  Step  2. 
Step  4  always  commenced  one  week  following  Step  3.   In  this 
way,  students  always  had  one  week  to  complete  their  revised 
(or  unrevised,  if  they  so  chose)  final  drafts. 

Essay  and  Re^vision  Guide  Data 

The  researcher  collected  all  xeroxed  copies  of  first 
drafts  and  written  revision  guide  responses  for  the  second, 
fourth,  sixth,  and  seventh  essays  written  by  the  40  students 
participating  in  the  study.   These  essays  are  referred  to  as  ' 
Sample  Essays  One,  Two,  Three,  and  Four,  respectively.   When 
the  final  drafts  of  each  essay  were  handed  in,  the  researcher 
xeroxed  these  drafts  and  returned  them  to  the  instructors  •  " 
within  24  hours.   Listed  in  Figure  2  are  the  assignments 
given  for  the  four  essays  examined  in  this  study. 

All  essays  and  revision  guide  responses  were  collected 
from  the  instructors  outside  of  class.   Students  not  involved 
in  interviews  did  not  see  the  researcher  after  the  first  day 
of  class  when  they  were  asked  to  participate  in  the  study, 
until  the  last  day  of  class,  when  they  were  thanked  for  their 
participation.   The  purpose  of  the  researcher's 
"invisibility"  to  the  students  was  to  reduce,  as  far  as 
possible,  their  awareness  of  being  involved  in  a  research 
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SELF-KVAT.TTATOR.q 


PEER    RVATJTATnR.q 


STEP  1    Assignment  given. 


Same, 


STEP  2     First  drafts  due. 

Xerox  copies  handed 
in  to  instructor. 
Revision  guides  dis- 
tributed.  Students 
begin  writing  their 
responses  to  revision 
guide  questions  in 
class . 


First  drafts  due, 
Xerox  copies  handed 
in.   Revision  guides 
distributed.   Each 
student  receives  a 
peer's  paper.   Students 
begin  writing  responses 
to  revision  guide  ques- 
tions in  class . 


STEP  3     Students  hand  in 
xerox  copies  of 
written  responses  to 
revision  guide  ques- 
tions to  instructor. 
Students  work  in 
class  on  revising 
papers. 


Students  hand  in  xerox 
copies  of  written 
responses  to  revision 
guide  questions.   Each 
student  discusses 
revision  guide  responses 
with  the  peer  whose 
paper  that  student 
received  in  Step  2 . 


STEP  4 


Final  drafts  submitted. 


Same . 


Figure  1 .   Procedure  followed  by  students  as  they  completed 
their  assigned  essays. 
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Essay  Nnrnhpr 


Instructor  Onp 


Instrnrtor  Twn 


(SAMPLE  ESSAY  ONE) 


Discuss  how  you 
became  a  Florida 
"Gator." 


Write  a 
narrative 
about  a 
memorable 
event  in  your 
life. 


(SAMPLE  ESSAY  TWO) 


Write  an  extended 
definition  of 
"power, "  "beauty, " 
or  "success." 


Same 


(SAMPLE  ESSAY  THREE) 


Write  an  essay 
which  discusses  the 
causes,  effect,  or 
both  the  causes  and 
effects  of  some 
phenomena . 


Same 


(SAMPLE  ESSAY  FOUR) 


Write  an  argumenta-  Same 
tive  essay  in 
favor  or  in  opposi- 
tion to  affirmative 
action  program. 


Figure  2-   Assignments  for  essays  collected  as  data. 
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study.   In  addition,  when  essays  were  collected  from  the 
instructors,  the  researcher  received  the  whole  set  of  essays 
for  each  section  and  picked  out  those  of  the  research 
subjects  without  revealing  to  the  instructors  the  identities 
of  the  research  subjects.   In  this  way,  any  biases  that  might 
have  affected  the  way  instructors  interacted  with  subjects 
were  precluded. 

It  is  important  to  note  that  the  two  instructors  differed 

,_     in  the  way  they  commented  on  their  students'  essays  and  in  the 
grading  policies  they  applied.   Instructor  One  commented  in 

v^'  ■  detail  on  all  first  drafts  and  assigned  each  one  a  grade  which 

would  rise  by  one-third  of  a  letter  grade  as  long  as  the  student- 
writer  put  forth  a  reasonable  effort  to  revise.   For  example,  if 
Instructor  One  assigned  a  grade  of  B  to  a  first  draft,  the  final- 
draft  grade  would  rise  to  B+  if  she  was  satisfied  that  the 
student  had  responded  to  her  first-draft  comments  and  evidenced 
an  honest  effort  to  improve  the  writing.   Lacking  this  response 
to  teacher  comments  and/or  the  honest  effort,  the  one-third 
grade  boost  would  be  withheld.   Instructor  One  always  returned 
first  drafts  with  her  grades  and  comments  prior  to  Step  3  shown 
in  Figure  1 . 

Instructor  Two,  in  contrast,  commented  only  briefly  on 
first  drafts.   She  did  not  assign  grades  until  students  had 
finished  their  revision  guide  activities  and  submitted  final 
drafts,  upon  which  she  commented  in  detail.   Both  instructors 
.  ^  ■  applied  their  commenting  and  grading  policies  in  the  same  way  to 
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both  of  the  sections  they  taught.   Neither  instructor's  grades 
or  conunents  were  available  to  the  holistic  scorers  who  rated 
essays  for  this  study. 

All  essays  were  required  to  be  typed,  thereby  eliminating 
the  problem  of  handwriting  interfering  with  the  holistic  scoring 
these  essays  would  be  given  (Freedman,  1981;  Charney,  1984) . 
Students  were  required  to  hand  in  xerox  copies  of  their  first 
drafts  and  written  revision  guide  responses  on  the  days  these 
items  came  due.   This  procedure  was  a  check  against  essays  being 
lost  by  students  and  a  way  of  making  sure  they  completed  the 
procedural  steps  for  each  essay  at  about  the  same  time.   It 
simplified  the  task  of  collecting  data,  since  these  copies  were 
handed  over  to  the  researcher  by  the  instructors. 

Description  nf  the  Two  Treatments 

Students  wrote  responses  to  revision  guides  for  each  of 
their  essays  from  the  second  through  the  seventh  and  final 
assignment.   Students  in  the  self-evaluating  sections  used  the 
guides  to  reflect  on  their  own  first  drafts  and  make  needed 
revisions  before  submitting  their  final  drafts.   Each  student  in 
the  peer-evaluating  sections  exchanged  papers  with  a  peer  and 
wrote  revision  guide  responses  for  that  peer's  papers.   Peer 
dyads  were  chosen  by  the  researcher  for  each  assignment;  these 
dyads  were  chosen  so  that  each  student  in  the  randomly  selected 
treatment  groups  would  be  paired  with  a  different  student  for 
each  assignment.   Lists  of  peer  dyads  were  prepared  by  the 
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researcher  and  given  to  each  instructor  prior  to  Step  2  (see 
Figure  1)  for  each  writing  assignment. 

After  students  had  written  their  revision  guide  responses 
for  each  essay,  peer-evaluating  students  met  in  pairs  during  one 
50-minute  class  period  to  discuss  each  other's  first  drafts, 
using  their  written  revision  guide  responses  as  a  basis  for  that 
discussion.   To  balance  the  time  spent  in  class  by  peer- 
evaluating  students  engaged  in  discussions,  both  instructors 
scheduled  a  corresponding  50-minute  period  for  self-evaluating 
students  to  work  in  class  on  their  own  essays,  using  their  own 
revision  guide  responses  to  stimulate  decisions  to  make  needed 
revisions . 

In  summary,  the  difference  between  the  two  treatments  was 
that  peer  evaluators  exchanged  papers,  wrote  revision  guide 
responses  for  each  other's  first  drafts,  and  engaged  in 
conversation  about  each  other's  writing,  while  self-evaluators 
wrote  revision  guide  responses  for  their  own  papers  and  spent 
time  in  class  considering  for  themselves  what  revisions  to  make 
in  their  own  writing. 

Treatment  of  Onantitativp  nsl-;^ 

Holistic  Quality  Scores 

In  order  to  measure  the  relative  quality  of  the  students' 
first  and  final  drafts,  all  essays  were  scored  holistically  by 
three  experienced  scorers.   Each  of  these  scorers,  as  did  the 
researcher,  had  5  years  of  experience  as  a  holistic  scorer  for 
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the  University  of  Florida  and  the  Florida  Department  of 
Education,  both  of  which  administer  scoring  sessions  for  essay- 
writing  tests  given  three  times  a  year.   Following  the 
procedures  used  in  these  university-  and  state-mandated  scoring 
sessions,  the  researcher  led  holistic  scoring  sessions  on  two 
consecutive  weekends  in  January  1988. 

One  difference  between  the  University  and  State  of  Florida 
scoring  sessions  and  the  ones  related  to  the  present  study  was 
the  scale  used.   In  the  former  scoring  sessions  a  1-through  4- 
point  scale  was  used,  with  1  representing  lowest  quality  and  4 
representing  highest  quality.   For  the  present  study,  an  8-point 
scale  was  used.   Scorers  were  told  to  divide  the  range  of 
quality  represented  by  each  point  on  the  4-point  scale  into  an 
upper  and  lower  category.   Therefore,  on  the  8-point  scale, 
scores  of  1  and  2  were  equivalent  to  the  score  of  1  on  the  4- 
point  scale,  and  so  on  up  to  scores  of  7  and  8,  representing  the 
lower  and  higher  halves  of  the  score  of  4  on  the  4-point  scale. 
,,  ..  By  using  this  8-point  scale,  the  researcher  hoped  to  achieve  a 
set  of  scores  which  would  more  precisely  represent  differences 
in  quality  between  drafts  than  was  possible  using  the  4-point 
scale .  •   .  1 

Prior  to  the  scoring  sessions,  the  researcher  prepared 
"range-finder  essays"  and  mixed  the  essays  to  be  scored  into  16 
batches.   Essays  from  the  four  assignments  collected  for  this 
study  were  kept  separate  from  each  other.   Thus,  there  were  four 
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batches  of  Sample  Essay  One,  four  of  Sample  Essay  Two,  and  so 
on.   Each  batch  contained  between  15  and  25  essays. 

Rangefinder  essays  are  sample  essays  used  in  holistic 
scoring  to  establish  and  maintain  maximum  agreement  among 
scorers.   Before  scoring  sessions  begin,  holistic  scorers 
typically  read  and  score  rangefinder  essays,  compare  the  scores 
they  give,  and  discuss  disagreements  until  a  consensus  is 
reached  regarding  the  score  of  each  rangefinder.   When  an 
acceptable  level  of  agreement  is  reached  and  is  maintained  for 
at  least  three  consecutive  rangef inders,  scorers  are  ready  to 
begin  reading  the  essays  that  will  receive  official  scores. 

The  rangefinders  for  this  study  were  collected  from 
students  in  the  four  treatment  sections  who  had  not  been 
selected  as  subjects  but  who  had  agreed  to  participate  in  the 
study.   The  researcher  privately  scored  a  large  batch  of 
rangefinders,  searching  through  the  essays  collected  for  this 
purpose  until  he  found  two  scoring  at  each  of  as  many  as 
possible  of  the  eight  levels  of  quality  represented  by  the  8- 
point  scale  to  be  used  in  this  scoring.   The  researcher  was  able 
to  find  essays  at  a  minimum  of  six  different  levels  for  each  of 
the  four  assignments  involved  in  the  study. 

Next,  a  University  of  Florida  graduate  student  who  also  had 
5  years  of  experience  as  a  holistic  scorer  independently  scored 
the  rangefinders  selected  by  the  researcher.   Through 
discussion,  complete  agreement  on  the  scores  for  all 
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rangefinders  was  established  between  this  reader  and  the 
researcher.  "■  - 

When  the  holistic  scoring  session  for  this  study  convened, 
the  researcher,  acting  as  chief  reader,  distributed  the 
rangefinders  for  the  first  four  batches  of  essays  to  be  scored, 
representing  one  of  the  four  assignments.   All  essays  from  each 
of  the  assignments  were  scored  together.   The  order  in  which 
four  assignments  came  before  the  readers  was  determined  by 
random  lot,  and  the  scorers  were  not  aware  of  when  in  the       ■■* 
semester  each  of  the  assignments  was  written.   Such  knowledge 
might  have  biased  their  scoring;  therefore,  the  precaution  of 
random  ordering  was  taken  to  deny  the  scorers  that  knowledge. 
In  addition,  no  essay  contained  any  information  identifying  the 
writer  or  the  section  from  which  the  essay  came  or  the  date  when 
it  was  written.   Essays  were  identifiable  only  by  a  5-digit  code 
number  written  on  each  one.  ' 

After  rangefinders  had  been  distributed  for  the  first 
randomly  selected  assignment  to  be  scored,  the  researcher  and 
the  scorers  discussed  the  nature  of  that  assignment.   The 
scorers  then  scored  and  discussed  rangefinders  until  all  were 
satisfied  that  agreement  was  at  an  acceptable  level. 

Scorers  submitted  their  scores  for  each  essay  by  entering 
that  essay's  code  number,  followed  by  a  numerical  score  between 
1  and  8,  on  a  slip  of  paper.   The  researcher  tabulated  the 
scores  as  they  came  in,  watching  for  disagreement  between 
scorers.   Whenever  two  scorers  diverged  by  more  than  2  points 
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for  a  particular  essay,  the  researcher  made  a  note  of  the 
disagreement.   When  the  scoring  session  ended,  these  discrepant 
scorings  were  discussed,  and  scorers  negotiated  until  all  scores 
were  within  2  points  of  each  other.   Of  the  320  first  and  second 
drafts  included  in  the  scoring  session,  58,  or  18%,  required 
that  scores  be  adjusted  after  discussion. 

A  series  of  Pearson  product-moment  correlation  calculations 
was  performed  to  determine  interrater  reliability  values.   Then, 
the  scores  were  submitted  to  a  three-factor  analysis  of  variance 
(ANOVA) ,  with  two  levels  of  treatment,  a  draft  factor 
representing  first  and  final  drafts,  and  a  factor  representing 
the  four  topics  of  writing  assignments  collected  for  this  study. 
Treatment  was  a  between-groups  factor;  draft  and  topic  were 
within-groups  (repeated  measures)  factors. 

Figure  3  displays  the  design  employed  for  the  quantitative 
treatment  of  data  for  this  study.   As  Figure  3  shows,  the 
quantitative  design  for  this  study  was  a  split,  split-plot 
factorial  type,  with  treatment  (labeled  "A"  in  the  figure)  as 
the  between-subjects  factor  and  occasions  (labeled  "B")  and 
prepost  (labeled  C)  as  the  within-subjects  factors. 

Analysis  of  Revisions 

Another  type  of  data  developed  for  this  study  was  derived 
from  a  line-by-line  comparison  of  all  first  and  final  drafts 
written  by  the  40  randomly  selected  students.   Four  essays  were 
collected  from  each  of  these  students,  for  a  total  of  160 
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A  =  Treatments 

B  =   Topics 

C  =  First  and  Final  Drafts 

S  =  Subjects 


Figure   3-      Quantitative   research   design, 
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essays.   The  researcher  coded  and  counted  each  revision  after 
identifying  it  as  belonging  to  one  of  six  levels  of  textual 
complexity  (see  Figure  4) .   Changes  from  first  to  final  draft  in 
punctuation,  spelling,  or  capitalization  were  coded  as  surface- 
level  revisions.   Similarly,  other  revisions  were  counted  at  the 
word,  phrase,  clause,  sentence,  and  multisentence  levels.   The 
following  example  demonstrates  the  distinction  between  clause 
and  sentence  with  regard  to  this  coding  scheme.   If  a  sentence 
such  as  "He  was  delighted"  were  deleted  from  an  essay,  the 
change  would  be  counted  as  a  sentence-level  revision.   However, 
if  the  sentence  "Because  the  fight  was  over,  he  was  delighted" 
were  changed  to  "Because  the  fight  was  over,  he  was  filled  with 
joy,"  the  change  would  be  coded  as  a  clause-level  revision.   In 
the  case  of  revisions  containing  more  than  one  level  at  the  same 
time,  each  change  was  considered  to  be  a  single  revision  and  was 
coded  at  the  highest  level  involved.   For  example,  if  "he 
enjoyed  several  sports"  were  changed  to  "he  enjoyed  fishing, 
bowling,  and  hunting, "  the  change  would  be  coded  as  one  phrase- 
level  revision;  the  punctuation  involved  in  the  revision  would 
not  be  coded  as  a  separate  event.   In  the  case  of  revisions  in 
which  a  unit  of  text  at  one  level  was  replaced  by  a  unit  of  text 
at  another  level,  two  revisions  would  be  coded,  one  for  the 
deletion  and  the  other  for  the  new  unit  being  added.   For 
example,  if  "He  enjoyed  several  sports"  were  changed  to  "He 
enjoyed  whatever  sports  were  in  fashion, "  the  deleted  phrase 
"several  sports"  would  count  as  one  phrase-level  deletion,  and 
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£ad£  Meaning    '  '  : :  :  f,"  ]     .  ' ' 

1  Revisions  made  in  punctuation, 
capitalization,  or  spelling. 

2  Revisions  involving  single  words. 

3  Revisions  involving  single  phrases. 

4  Revisions  involving  single  clauses. 

5  Revisions  involving  single  sentences. 
/■  .   '■■..*.  '        Revisions  involving  multiple  sentences 

Figure  4 .  Revision  coding  system.                ■  '  .,■. 


V^cc.r^ 


75 
the  added  clause  "whatever  sports  were  in  fashion"  would  count 
as  one  clause-level  addition.   Finally,  all  multiple-sentence 
substitutions  were  counted  as  two  revisions,  one  a  deletion  and 
the  other  an  addition.   The  purpose  of  this  approach  to  coding 
at  the  multisentence  level  was  to  account  for  instances  in  which 
relatively  short  passages  of  text  were  replaced  by  relatively 
longer  ones,  or  vice  versa.   To  check  the  consistency  and 
accuracy  with  which  these  coding  principles  were  applied  to  the 
students'  essays,  the  researcher  consulted  with  a  doctoral 
student  in  linguistics  at  the  University  of  Florida,  who 
reviewed  10  pairs  of  first  and  final  drafts  coded  by  the 
researcher  and  corroborated  the  correctness  and  consistency  with 
which  revisions  were  assigned  to  categories. 

After  coding,  the  revisions  made  by  each  student  on  each  of 
the  four  sample  essays  were  totaled  and  recorded  on  tally 
sheets.   For  the  first  five  levels  of  textual  complexity,  this 
process  was  straight-forward — each  revision  counted  as  an 
individual  unit.   However,  in  the  case  of  multisentence 
revisions,  the  count  was  determined  on  the  basis  of  "words  per 
revision."   For  example,  if  35  words  of  multisentence  text  were 
deleted  and  replaced  by  50  words  of  multisentence  text,  the 
change  would  be  counted  as  85  words  of  multisentence  revision. 
This  approach  to  counting  was  adopted  to  account  for  the  widely 
varying  lengths  of  revision  that  were  possible  at  this  level  of 
textual  complexity. 
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The  data  representing  revisions  were  then  submitted  to  a  2 
X  6  repeated-measures  ANOVA  test  to  determine  whether 
differences  existed  between  the  two  treatment  groups  at  each  of 
the  six  levels.   For  each  instructor,  a  series  of  six  ANOVA 
tests  were  run,  one  for  each  level  of  textual  complexity.   To 
account  for  the  different  lengths  of  student  essays,  revision 
counts  were  converted  to  "number  of  revisions  per  100  words  of 
first-draft  text,"  in  the  case  of  surface,  word,  phrase,  clause, 
and  sentence-level  revisions.   For  multisentence  revisions, 
counts  were  converted  to  "number  of  words  of  revision  per  100 
words  of  first  draft  text."   Had  this  precaution  not  been  taken, 
a  20-word  multisentence  revision  and  a  200-word  multisentence 
revision  would  both  have  been  counted  as  "one  revision, "  causing 
obvious  distortions  in  the  data. 

Since  these  series  of  ANOVA  tests  were  being  applied  to 
identical  data  for  each  instructor,  the  alpha  level  set  for 
testing  significance  at  each  level  of  textual  complexity  was 
.05/6,  or  .0083. 

Treatment  of  nualitat-ive  Data 

Revision  Guides 

After  completion  of  their  first  drafts,  students  were 
required  to  respond  in  writing  to  a  set  of  questions  and 
directions  designed  to  help  them  evaluate  their  own  or  a  peer's 
writing  beyond  the  level  of  spelling,  capitalization,  and 
punctuation  and  to  help  them  consider  more  global  issues  such  as 
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audience  needs  and  overall  text  structure  as  they  decided  where 
and  how  much  revising  was  called  for.   These  sets  of  questions 
and  directions  were  called  "revision  guides."   (See  Appendix  for 
complete  set  of  revision  guides  used  in  this  study.)   For 
example,  the  revision  guide  corresponding  to  the  seventh  and 
final  writing  assignment,  which  called  for  an  argumentative 
essay,  included  the  following  items: 

1.  Evaluate  the  way  the  writer  introduces  the 
controversy  underlying  the  essay.   Are  two  (or 
more)  conflicting  opinions  regarding  the  topic 
clearly  defined?   Explain  your  answer. 

2.  How  effectively  does  the  writer  use  logic  to 
support  his  or  her  position?   Give  an  example  of 
an  explicitly  stated  application  of  logical 
reasoning  in  the  essay.   Evaluate  the 
effectiveness  of  the  example  you  choose.   If  you 
cannot  find  such  an  example,  briefly  discuss  the 
extent  to  which  you  think  the  essay  suffers  as  a 
result.  ■'^■■■ 

3.  How  well  does  the  writer  counter  anticipated 
objections  to  his  or  her  own  arguments?   Explain 
your  answer. 

4.  Does  the  writer  employ  emotional  language  to 
support  his  or  her  argument?   If  not,  is  this  a 
fault?   If  so,  how  effectively  does  the  writer 
use  emotional  language  to  advance  his  or  her 
argument?   Explain  your  answer. 

Interview  Data 

At  the  end  of  September,  the  beginning  of  November,  and  the 
beginning  of  December  1987,  the  researcher  interviewed  the  16 
students  who  had  agreed  to  participate  in  this  part  of  the 
study.   Each  interview  involved  one  student  and  lasted  between 
20  and  40  minutes.   The  first  interview  was  timed  so  that 


w 


IB 
students  would  have  just  finished  writing  their  final  draft  of 
Sample  Essay  One.   The  second  and  third  interviews  bore  the 
same  relationship  in  time  to  the  students'  writing  of  Sample 
Essays  Two  and  Three.   The  students  had  not  received  their 
final  grades  for  the  essays  they  discussed  in  the  interviews, 
and  the  researcher  had  not  read  the  essays  prior  to  the 
interview. 

The  researcher  followed  the  interview  structure  shown  in 
Figure  5  for  all  48  interviews  completed  for  this  study.   Only 
occasionally  did  he  deviate  from  this  format  in  the  interest  of 
following  the  "flow"  of  conversations  with  students.  •  ' 

The  target  questions — numbers  5,  11,  and  13 — were  the  ones 
considered  most  relevant  to  this  study  by  the  researcher.   The 
responses  to  these  questions  are  presented  in  Chapters  Four  and 
Five.   The  remaining  questions  in  the  interviews  were  intended 
to  "set  up"  the  target  questions,  to  lead  the  interviewee  into  a 
-,  frame  of  mind  in  which  his  or  her  responses  to  the  target 
questions  would  emerge  as  part  of  a  conversation,  without  being 
highlighted.   By  repeating  the  target  questions  at  monthly 
intervals,  the  researcher  attempted  to  elicit  responses  which 
might  indicate  any  changes  that  might  have  occurred  in  the    •  • 
students'  conceptions  of  revision  and  in  their  reaction  to  the 
experimental  treatments. 
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First  Tn1-.f^rvipw  Only 

1 .  What  have  been  the  main  influences  on  you  as  you  have 
learned  how  to  write? 

2 .  Do  you  change  the  way  that  you  write  in  different 
situations? 


All  Interviews 

3 .  How  do  you  go  about  writing  an  essay? 

4.  Do  you  finish  in  one  sitting? 

5.  (TARGET  QUESTION)   What  do  you  do  when  you  revise  your 
first  draft? 

6.  Is  it  easier  for  you  to  revise  as  you  are  writing  or  after 
you  have  finished  a  draft? 

7.  How  do  you  know  when  an  essay  is  finished? 

8.  Beginning  from  the  time  you  were  given  the  assignment  to 
write  your  last  essay  for  ENC  1101,  please  tell  me  the 
story  of  how  you  went  about  the  task  of  completing  the 
assignment , 

9.  Did  you  become  stuck  at  any  point  in  the  process  of  writing 
that  essay. 

10.  How  long  did  it  take  you  to  write  that  essay? 

11.  (TARGET  QUESTION)   What  effect  did  the  revision  guide 
activity  have  on  the  way  that  you  wrote  that  essay? 

12.  What  grade  would  you  give  yourself  on  that  essay?  What 
made  you  arrive  at  that  grade? 

Second  and  Third  TnterviPws 

13.  (TARGET  QUESTION)   Has  anything  changed  in  the  way  that  you 
write  as  a  result  of  your  experience  in  ENC  1101? 


Figure  5.   Interview  questions, 
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Reporting  of  Oualitati vp  Data 

The  researcher  examined  qualitative  data  originating  in  the 
specific  revisions  made  in  student  essays,  written  revision 
guide  responses,  and  interview  responses  in  order  to  answer  the 
five  research  questions  posed  in  Chapter  One.   Student  responses 
to  the  target  questions  in  the  interviews  were  paraphrased  and 
tabulated.   Then,  the  researcher  compared  these  target-question 
responses  with  the  revising  behavior  evident  in  final-draft 
essays  and  written  revision  guide  responses.   Results  of  the  • 
qualitative  data  analysis  are  reported  in  Chapter  Five. 
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CHAPTER  FOUR 
QUANTITATIVE  FINDINGS 


This  chapter  contains  the  results  of  quantitative 
analyses  applied  to  data  collected  from  both  instructors' 
students.   The  findings  for  each  instructor  will  be  presented 
under  separate  headings.   For  each  instructor,  two 
applications  of  statistical  analyses  will  be  discussed: 
first,  the  mathematical  operations  associated  with  a  three- 
factor  ANOVA  test  of  significance  for  holistic  scores; 
second,  the  mathematical  operations  associated  with  ANOVA 
tests  of  significance  for  revisions  at  each  of  six  levels  of 
textual  complexity. 

Analvses  of  Holistic  Snores 

Inter-Rater  Reliahnil-y 

Instructor  One.   The  Pearson  product -moment  correlation 
values  displayed  in  Table  3  represent  the  degree  to  which 
inter-rater  reliability  was  achieved  for  essays  written  by 
Instructor  One's  students. 

These  inter-rater  reliability  values  were  lower  than  the 
researcher  considered  desirable;  nevertheless,  18  of  the  24 
inter-rater  reliability  coefficients  exceeded  .60.   Five  of 
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Table   3 

■    Inter-Rater   Reliability   Coefficients     ^Pearson    Product-Moment. 

Correlations)    for   Raters  Reading   Essays   by    Instructor   One's 
,    Students 

Raters    1    and   2  Raters    1    and   3                    Raters    2    and   3 

1st   Draft      2nd  Draft  1st   Draft      2nd  Draft      1st  Draft      2nd  Draft 


Sample  .69  .58  .48                        .33  .53                     .52 

Essay  (p<.000)  (p<.004)  (p<.017)  (p<.054)  (p<.008)  (p<.009) 
One 

Sample  .75  .57  .76                        .74  .65                     .80 

Essay  (p<.000)  (p<.004)  (p<.000)  (p<.000)  (p<.001)  (p<.000) 
Two                                                                                                                                                          ^ 

Sample  .64  .75  .74                        .64  .80                     .65 

Essay  (p<.001)  (p<.000)  (p<.000)  (p<.001)  (p<.000)  (p<.001) 
Three 

Sample  .64  .71  .86                      .75  .76                    .87 

Essay  (p<.001)  (p<.000)  (p<.000)  (p<.000)  (p<.000)  (p<.000) 
Four 


the   six   coefficients   that   did  not   exceed    .60   occurred   for 
Sample   Essay  One.      Furthermore,    because   scores   across   the 
three   raters   were   summed  to   create   the   holistic   quality 
scores   used   in   subsequent   analyses,    the   discrepancies    in 
scores   across  the  three   raters   was  not   as   critical   as   if 
different    raters   had   scored  different    essays.      As   Crocker   and 
Algina    (1986)    have  pointed  out,    as   the   number   of   raters 
scoring  the   same   essay   increases    in   a   holistic   scoring 
session,    the   error   implicit    in   each  one's    score   is 
increasingly   cancelled  out   by  the   error   implicit    in   all   the 
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others'  scores,  assuming  that  their  scores  are  summed  or 
averaged  to  derive  a  final  score.   In  other  words,  if  an 
infinite  number  of  raters  could  have  been  assembled  to  score 
the  essays  written  for  this  study,  one  might  have  perfect 
confidence  in  the  summed  or  averaged  scores  obtained  for  each 
essay.   Because  only  three  raters  were  employed  in  this 
study,  the  sum  of  the  three  raters ' scores  may  not  have  been  a 
highly  accurate  estimate  of  a  student's  true  score. 

Instructor  Two.   Table  4  displays  the  Pearson  product- 
moment  correlation  values  comparing  the  three  raters'  scoring 
essays  written  by  Instructor  Two's  students. 

Similar  to  the  values  shown  in  Table  3,  these  results 
were  lower  than  desired.   Again,  reliability  among  raters  was 
lowest  for  Sample  Essay  One.   This  time,  however,  13  of  the 
24  coefficients  were  less  than  .60.   Issues  related  to  inter- 
rater  reliablity  in  this  study  will  be  discussed  in  Chapter 
Six. 

Descriptive  Means  and  Standard  Deviations 

To  avoid  a  proliferation  of  quantities  with  decimal 
fractions,  the  quality  score  assigned  to  each  essay  draft  was 
the  sum  of  the  three  scores  given  by  the  holistic  raters. 
The  lowest  score  actually  earned  by  a  draft  in  the  sample  was 
4,  representing  scores  of  1,  1,  and  2  given  by  the  individual 
raters.   The  highest  score  actually  earned  by  a  draft  in  the 
sample  was  21,  the  sum  of  three  scores  of  7 .   In  order  to 
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Table  4 

Inter-Rater  Reliability  Coefficients  (Pearson  Product -Moment-. 
Correlations)  for  Raters  Reading  Essays  by  Instructor  Two's 
Students 


Raters  1  and  2 Raters  1  and  3        Raters  2  and  3 

1st  Draft   2nd  Draft   1st  Draft   2nd  Draft   1st  Draft   2nd  Draft 


Sample  .20  .35  .57  .42  .29  .72 

Essay  (p<.195)  (p<.066)  (p<.004)  (p<.034)  (p<.lll)  (p<.000) 
One 

Sample  .48  .53  .43  .77  .71  .53 

Essay  (p<.016)  (p<.008)  (p<.031)  (p<.000)  (p<.000)  (p<.009) 
Two 

Sample  .59  .72  .63  .69  .72  .59 

Essay  (p<.003)  (p<.000)  (p<.002)  (p<.000)  (p<.000)  (p<.003) 
Three 

Sample  .60  .52  .44  .63  .75  .71 

Essay  (p<.003)  (p<.010)  (p<.026)  (p<.001)  (p<.000)  (p<.000) 
Four 


avoid  the  problems  of  interpretation  inherent  in  a  4-21 
scale,  the  researcher  reduced  all  combined  scores  by  3 
points,  yielding  the  1-18  scale  used  in  reporting  results  in 
this  study.   Such  a  linear  transformation  of  the  data  had  no 
effect  on  analysis  results  in  which  comparisons  were  made. 

Instryctor  One-   Table  5  displays  the  mean  holistic 
scores  and  standard  deviations  for  each  draft  of  each  sample 
essay  written  by  students  in  Instructor  One's  sections  of  ENC 
1101. 
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Table   5 

Mean   Holistic   Scores    of   Sample   Essays     anstructor   One),    Scale: 
tjS. 


Sample  Essay  Sample  Essay  Sample  Essay        Sample  Essay 

One  Two  Three  Four 


1st  2nd  1st  2nd  1st  2nd  1st  2nd 

Draft      Draft  Draft      Draft  Draft      Draft        Draft      Draft 


Self- 
Evaluating 
Students 

Mean  8.9        11.0  6.8  7.4  6.8  8.1  6.7        7.5 

(Std.    Dev.)  (2.4)        (2.8)  (3.5)        (4.7)  (3.0)  (3.7)  (4.1)       (4.2) 


Peer- 
Evaluating 
Students 


Mean  9.8    11.5      9.1    9.5      9.3    11.0     10.1    11.4 

(Std.  Dev.)    (1.8)   (1.3)     (3.7)   (2.9)     (3.3)    (3.2)    (3.7)   (3.2) 


Instructor  Two.   Table  6  contains  the  means  and  standard 
deviations  for  holistic  scores  earned  by  students  in 
Instructor  Two's  sections. 

Three-Factor  ANOVA  Results 

The  scores  of  all  drafts  of  sample  essays  written  by 
each  instructor's  students  were  submitted  to  a  three-factor 
analysis  of  variance.   The  three  factors  were  group  (i.e.. 
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Table  6 


Mean  Holistic  Scores  of  Sample  Essays  (Inst.rur.rnr    Two),     ^r.ale^.: 
1-18  Points 


Sample  Essay    Sample  Essay    Sample  Essay   Sample  Essay 
One  Two  Three  Four 


1st     2nd      1st     2nd      1st     2nd     1st     2nd 
Draft  Draft    Draft  Draft    Draft  Draft   Draft  Draft 


Self- 
Evaluating 
Students 

Mean         10.6   10.6 

(Std.  Dev.)   (2.4)   (3.2) 


5.9    9.1 
(2.8)   (3.3) 


9.4     10.8      8.8    11.2 
(2.9)    (3,2)    (4.6)   (3.7) 


Peer- 
Evaluating 
Students 

Mean         10.5    10.5 

(Std.  Dev.)   (1.6)   (1.4) 


9.1    11.1       8.1     11.4     11.8    13.7 
(3.0)   (3.1)     (4.1)    (3.5)    (2.5)   (3.5) 


*  » -  . 
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self-evaluation  and  peer-evaluation) ,  draft  (i.e.,  first  and  ■. 
final  drafts),  and  topic  (i.e.,  the  four  essay  assignments 
collected  for  this  study) .   In  this  analysis,  group  was 
considered  a  between-subjects  factor;  draft  and  topic  were 
within-subjects  factors. 

Instructor  Opp.   Table  7  contains  the  results  of  the  three- 
factor  ANOVA  applied  to  the  holistic  scores  of  Instructor  One's 
students.   As  shown  in  Table  7,  the  main  effect  for  Group  was 
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Table  7 

Three-Factor  ANOVA  Test  of  Significance  Comparing  Hoi i stir 
Scores  of  Self-Evaluating  and  Peer-Evaluating  Students 
(Instructor  Qne^ 


Sum  of 

Degrees  of 

Mean 

Source 

Squares 

Freedom 

Square 

F -Value 

Probability 

Mean 

13122.506 

1 

13122.506 

324.70 

.0000 

Group 

213.906 

1 

213.906 

5.29 

.0336* 

Error 

727.463 

18 

40.415 

Topic 

97.319 

3 

32.440 

2.67 

.0568 

Topic 

X 

Grp 

48.519 

3 

16.173 

1.33 

.2743 

Error 

656.788 

54 

12.163 

Draft 

61.256 

1 

61.256 

21.59 

.0002* 

Draft 

X 

Grp 

0.056 

1 

0.056 

0.02 

.8896 

Error 

51.063 

18 

2.837 

Draft 

X 

Topic 

11.769 

3 

3.923 

1.34 

.2718 

Draft 

X 

Topic 

X 

Group 

1.969 

3 

0.656 

0.22 

.8795 

Error 

158.388 

54 

2.933 

*Significant  at  alpha  =  .05 


significant  (p  =  .03) .   This  result  may  be  interpreted  as 
reflecting  a  difference  in  the  quality  scores  earned  by  the 
self-evaluators  and  peer-evaluators  averaged  over  drafts  and 
topics.   However,  from  Table  5,  it  is  apparent  that  the 
students  in  the  section  where  peer-evaluation  was  used  were 
better  writers  from  the  outset  than  were  the  students  in  the 
section  where  self-evaluation  was  used.   Therefore,  this 
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result  does  not  indicate  a  treatment  effect  favoring  peer- 
evaluation. 

The  main  effect  of  the  Topic  variable,  that  is,  of  the 
four  different  writing  assignments  represented  in  the  sample, 
was  not  significant,  indicating  that  the  writing  assignments 
did  not,  taken  by  themselves,  have  a  significant  effect  on 
holistic  scores. 

The  main  effect  of  the  Draft  variable  was  significant 
(p  <  .0002),  indicating  a  distinct  general  improvement  in  the 
quality  of  the  average  final  draft  compared  with  the  quality 
of  the  average  first  draft.   This  result  was  apparent  from 
inspection  of  the  means  in  Table  5. 

The  remaining  values  in  Table  7  represent  the  effects  of 
interactions  between  and  among  the  variables.   In  this  case 
none  of  the  interactions  involving  these  main  variables 
achieved  the  threshold  set  to  determine  statistical 
significance  (p  <  .05) .   There  is  no  evidence  of  a  positive 
impact  by  the  peer-evaluation  treatment  on  final-draft      -; 
performance  because  the  draft -by-group  interaction  was  not 
significant.   In  concert  with  the  significant  effects  for 
Group  and  Draft,  the  only  appropriate  conclusion  to  be  drawn 
is  that  the  two  treatment  groups  differed  in  writing  ability 
overall  and  that  this  difference  remained  fairly  constant 
from  first  drafts  to  final  drafts  consistently  over  the  four 
topics,  even  though  both  groups  increased  their  holistic 
scores  through  revision. 
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Instructor  Two.   Table  8  contains  the  results  of  the 
three-factor  ANOVA  applied  to  the  holistic  scores  of 
Instructor  Two's  students. 

Table  8 

Three-Factor  ANOVA  Test-  nf  .Si  ani  f  icance  Cnrnparing  HoTistir. 
Scores  of  Self-Evaluatina  and  Peer-F.val  uati  ng  .qtudents 
(Instructor  Two^ 


Sum  of 

Degrees  of 

Mean 

Source 

Squares 

Freedom 

Square 

F-Value 

Probability 

Mean 

16422.756 

1 

16422.756 

454.04 

.0000 

Group 

66.306 

1 

66.306 

1.83 

.1925 

Error 

651.063 

18 

36.170 

Topic 

129.669 

3 

43.223 

4.33 

.0083* 

Topic 

X 

Grp 

92.619 

3 

30.873 

3.09 

.0345* 

Error 

539.088 

54 

9.983 

Draft 

117.306 

1 

117.306 

38.38 

.0000* 

Draft 

X 

Grp 

0.306 

1 

0.306 

0.10 

.7552 

Error 

55.013 

18 

3.056 

Draft 

X 

Topic 

41.619 

3 

13.873 

4.19 

.0098* 

Draft 

X 

Topic 

X 

Group 

12.319 

3 

4.106 

1.24 

.3045 

Error 

178.938 

54 

3.313 

^Signif leant  at  alpha  =  .05 


As  shown  in  Table  8,  the  main  effect  for  Group  was  not 
significant  (p  <  .19).   However,  the  main  effect  for  Topic 
was  significant  (p  <  .008),  as  was  the  main  effect  for  Draft 
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(p  <  .001)  .   In  addition,  two  interactions  between  variables 
were  statistically  significant.   First,  the  Topic-by-Group 
interaction  (p  <  .03)  indicated  that  differences  in  the 
performance  of  the  two  treatment  groups  was  not  consistent 
over  the  four  topics.  . 

Analyses  of  Rpvi  qi  nnc; 

Descriptive  Means  and  .qi-;=indard  Dpvjatinns 

Instructor  One.   As  stated  in  Chapter  Three,  the 
students  participating  in  this  study  were  required  to 
respond  in  writing  to  revision  guide  questions  and  directions 
concern  specific  features  of  their  first  drafts.   This 
activity  encouraged  students  to  evaluate  critically  their 
first  drafts  and  to  make  needed  revisions  before  submitting 
their  essays  for  final  grades.   Thus,  another  question  of 
interest  in  this  study  was  whether  students  who  wrote 
responses  for  their  own  papers  would  differ  in  amount  and 
type  of  revisions  from  those  who  received  the  comments  of 
peers  regarding  their  first  drafts.   In  order  to  identify  any 
differences  in  the  revising  behavior  of  the  treatment  groups, 
all  revisions  made  in  first  drafts  were  identified  and  coded 
according  to  one  of  the  following  six  levels  of  textual 
complexity:   surface,  word,  phrase,  clause,  sentence,  and 
multisentence.   Revisions  made  at  each  level  by  each  student 
were  counted  and  tabulated.   Table  9  displays  the  means  and 
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Table  9 

Means  and  Standard  npyiations  nf  Revi.q-Jons  per  100  Words  nf 
First-Draft  Text  at  Six  T.evels  nf  Textual  Complexity 
(Instructor  One) 


Level 


Essay  Topic 


U 


Surface: 

Self-Evaluators 

Mean 
(Std.  Dev.) 

Peer-E valuators 


Peer-E valuators 


1.7 

(.7) 


1.0 
(.9) 


.8 

(1.0) 


2.0 
(2.0) 


Mean 

1.8 

1.3 

.6 

1.7 

(Std.  Dev.) 

(.8) 

(.8) 

(.5) 

(1.8) 

Word: 

Self-Evaluators 

Mean 

2.2 

1.2 

1.3 

1.6 

(Std.  Dev.) 

(.8) 

(.8) 

(.5) 

(1.8) 

Mean 
(Std.  Dev.) 

1.1 
(1.2) 

1.6 
(1.8) 

1.1 
(.8) 

.6 
(.7) 

Phrase: 

Self-Evaluators 

Mean 
(Std.  Dev.) 

1.1 
(.9) 

.7 
(.8) 

.6 
(.5) 

.6 
(.7) 

Peer-E valuators 


Mean 

.7 

.6 

.3 

.4 

(Std. 

Dev. ) 

(.4) 

(.4) 

(.3) 

(.3) 

k'.-"-. 


Table  9 — Continued 


Peer-E valuators 


Peer-Evaluators 


Peer-E valuators 
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Level 

Ess 

ay 

Top 

ic 

1 

2 

3 

4. 

Clause: 

Self-Evaluators 

Mean 

.9 

.3 

.4 

.4 

(Std.  Dev.) 

(.6) 

(.5) 

(.3) 

(.4) 

Mean 
(Std.  Dev.) 

.4 
(.5) 

.4 
(.3) 

.3 
(.4) 

.1 
(.2) 

Sentence: 

Self-Evaluators 

Mean 
(Std.  Dev.) 

.1 
(.2) 

.2 
(.2) 

.1 
(.2) 

.03 
(.1) 

Mean 
(Std,  Dev.) 

.1 
(.2) 

.1 

(.1) 

.1 
(.2) 

.2 

(.3) 

Multisentenrpr  * 

Self-Evaluators 

Mean 
(Std.  Dev.) 

5.1 
(6.5) 

2.8 

(5.4) 

5.8 
(15.7) 

2.8 
(5.4) 

Mean 

3, 

.3 

2 

.2 

~   5, 

.6 

.0 

(Std. 

Dev. 

) 

(8, 

.4) 

(5 

.3) 

(14, 

.6) 

( 

.0) 

*Values  at  this  level  indicate  "number  of  words  in  multi- 
sentence  revisions  per  100  words  of  first  draft  text." 
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standard  deviations  for  revisions  made  at  each  level  of 
textual  complexity. 

The  values  in  Table  9  represent  the  number  of  revisions 
at  a  particular  level  per  100  words  of  first-draft  text,  in 
the  case  of  the  first  five  levels  of  textual  complexity. 
This  conversion  of  values  into  the  form  "x  per  100  words"  was 
performed  to  eliminate  distortions  resulting  from  the  varying 
lengths  of  the  students'  essays.   In  the  case  of  the  sixth 
level  of  textual  complexity,  multisentence,  the  values  in 
Table  9  represent  the  number  of  words  of  revision  at  this 
level  per  100  words  of  first-draft  text.   To  count  each  multi- 
sentence  revision  as  a  single  unit  would  have  meant 
considering  a  25-word  2-sentence  revision  to  be  equal  to  a 
300-word  20-sentence  one.   Therefore,  the  researcher  chose 
this  way  of  counting  multisentence  revisions. 

An  examination  of  Table  9  reveals  little  difference 
between  the  two  treatment  groups  in  terms  of  revisions  made 
at  the  first  five  levels  of  textual  complexity,  or  the  amount 
of  revising  done  at  the  sixth  level. 

Instructor  Two.   Table  10  contains  the  mean  number  of 
revisions  per  100  words  of  first-draft  text  made  by 
Instructor  Two's  students.   For  the  first  five  levels  of 
textual  complexity,  the  values  in  Table  10  indicate  mean 
number  of  revisions  counted  as  individual  units.   In  the  case 
of  the  sixth  level,  the  values  represent  the  mean  number  of 
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Table  10 


First-Draft  Text  at  Six  Levels 

Of 

Textual 

Comolexitv 

(Instructor  Two) 

Level 

Essay 

Topic 

1 

2 

3 

4 

Surface: 

Self-Evaluators 

Mean                .  7 
(Std.  Dev.)         (.3) 

00  00 

• 

.3 

(.4) 

.4 

(.4) 

Peer-Evaluators 

Mean 
(Std.  Dev.) 

Mord: 

Self-Evaluators 

Mean 
(Std.  Dev.) 

Peer-Evaluators 


.9        .4        .5        .4 
(1.2)       (.3)       ('.6)  {'.5) 


2.3        1.4 
(1.0)       (1.2) 


.9        1.2 
(.9)       (1.1) 


Mean 

1.1 

1.3 

.6 

1.2 

(Std.  Dev.) 

(1.2) 

(.9) 

(.7) 

(.7) 

EJirasa: 

Self-Evaluators 

Mean 

1.7 

1.2 

1.1 

1.3 

(Std.  Dev.) 

(1.1) 

(1.3) 

(.7) 

(1.4) 

Peer-Evaluators 


\  '"■ 

Mean 
(Std. 

Dev. ) 

1.0 
(1.1) 

1.1 
(.9) 

1.0 
(.8) 

.9 
(.8) 

• 
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Table  10 — Continued 


Level 

Ess 

ay 

Top 

ic 

1 

2 

3 

4 

Clause: 

Self-Evaluators 

Mean 
(Std.  Dev.) 

.3 
(.4) 

.2 

(.2) 

.2 

(.2) 

.02 
(.1) 

Peer-E valuators 

Mean  .1         .2         .1         .1 

(Std.  Dev.)         (.2)       (.2)       (.3)       (.2) 

Sentence: 

Self-Evaluators 

Mean  .5         .5         .3         .2 

(Std.  Dev.)         (.6)       (.4)       (.3)       (.3) 

Peer-Evaluators 

Mean  .3         .6         .5         .2 

(Std.  Dev.)         (.4)       (.4)       (.3)       (.2) 

Multisentence:* 

Self-Evaluators 

Mean  10.2       94.7       44.4        52.8 

(Std.  Dev.)        (14.3)     (107.2)      (61.0)       (85.3) 

Peer-Evaluators 

Mean  3.3       16.8       33.7        41.4 

(Std.  Dev.)        (6.5)     (13.7)     (45.0)      (69.4) 


*Values  at  this  level  indicate  number  of  words  in  multi- 
sentence  revisions  per  100  words  of  first-draft  text. 
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.  words  involved  at  this  level  per  100  words  of  first-draft 
text .  ■ 

As  Table  10  shows.  Instructor  Two's  students  engaged  in 
considerable  multisentence  revising.   Moreover,  this  large- 
scale  revising  showed  a  consistent  pattern  of  increase  across 
the  four  points  of  measurement  for  the  peer-evaluators .   In 
the  case  of  self-evaluators,  the  pattern,  although  not 
consistently  one  of  increase,  shows  that  these  students 
revised  more  at  the  multisentence  level  than  did  the  peer- 
evaluators  . 

ANQVA  Tests  nf  filanif  i  cannf^ 

Instructor  One-   The  revision  data  for  Instructor  One 
were  submitted  to  a  series  of  six  ANOVA  tests  of 
significance,  one  for  each  level  of  textual  complexity.   The 
results  of  these  tests  are  shown  in  Table  11.   The  only  F- 
ratio  in  Table  11  indicating  a  statistically  significant 
difference  is  associated  with  the  Topic  variable  at  the 
surface  level.   Looking  back  at  Table  10,  one  sees  that  this 
statistically  significant  difference  represents  quite 
unimpressive  differences  in  revising  behavior.   For  example, 
the  range  within  which  these  differences  were  found  was 
bounded  on  the  low  end  by  the  value  of  .3  surface-level 
revisions  per  hundred  words  of  first-draft  text  and  on  the 
high  end  by  .9  revisions  per  hundred  words.   Surface-level 
revision,  it  should  be  remembered,  involves  changes  in 
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Table    11 

ANOVA   Tests    of    Significance    at    Six   Levels    of    Tpxtnal 
Complexity    (Instructor   One^ 


Source   of 
Variance 


Sum  of 
Squares 


Degrees   of 
Freedom 


Mean 
Square 


F-Value  Probability 


Surface  Level : 


Group 

.07200 

1 

.07200 

.04 

.84 

Topic 

18.38250 

3 

6.12750 

5.20 

.003* 

Group  X  Topic 

1.14700 

3 

.38233 

.32 

.81 

ird  Level: 

Group 

3.69800 

1 

3.69800 

1.66 

.21 

Topic 

3.16300 

3 

1.05433 

.88 

.46 

Group  X  Topic 

7.82100 

3 

2.60700 

2.16 

.10 

Phrase  Level : 


Group 

1.56800 

1 

1.56800 

3.40 

.08 

Topic 

3.39350 

3 

.79783 

2.82 

.05 

Group  X  Topic 

.39000 

3 

.13000 

.46 

.71 

Clause  Level : 


Group 

.66612 

1 

.66612 

2.87 

.11 

Topic 

1.55937 

3 

.51979 

3.25 

.03 

Group  X  Topic 

1.21237 

3 

.40412 

2.53 

.07 

Sentence  Level : 


Group 

.01512 

1 

.01512 

.44 

.52 

Topic 

.02637 

3 

.00879 

.23 

.87 

Group  X  Topic 

.20437 

3 

.06812 

1.80 

.16 

Multisentence 

Level: 

Group  34.71613 

Topic  219.96938 

Group  X  Topic    21.53437 


1 

34.71613 

.32 

.58 

3 

73.32313 

1.00 

.40 

3 

7.17812 

.10 

.96 

^Signif leant  at  alpha  =  .0083. 
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spelling,  capitalization,  and  punctuation.   Such  changes  do 
little  to  alter  the  meaning  to  be  found  within  a  text. 

Instructor  Two.   Following  procedures  identical  to  those 
described  above  for  Instructor  One,  the  revision  data  for 
Instructor  Two  were  submitted  to  a  series  of  six  ANOVA  tests 
of  significance,  one  for  each  level  of  textual  complexity. 
As  shown  in  Table  12,  none  of  the  comparisons  of  Instructor 
Two's  treatment  groups  returned  a  result  of  "statistically 
significant  difference"  (alpha  =  .05/6  =  .0083). 

Summary.   Analysis  of  quantitative  data  reported  above 
indicates  that  the  self-evaluation  and  peer-evaluation 
treatments  employed  in  this  study  were  about  equal  in  their 
effects  on  essay  quality  and  revising  behavior.   The 
statistically  significant  difference  between  treatment  groups 
for  essay  quality  in  the  case  of  Instructor  One's  students 
may  not  be  attributed  to  a  treatment  effect.   No  significant 
differences  in  essay  quality  between  the  two  treatment  groups 
occurred  for  Instructor  Two's  students.   Moreover,  no  pattern 
of  difference  between  the  treatment  groups  emerged  from  the 
analyses  of  revision  data  of  either  Instructor  One  or 
Instructor  Two.   Therefore,  none  of  the  null  hypotheses 
stated  in  Chapter  One  may  be  rejected. 

However,  the  quantitative  analyses  did  turn  up  two 
interesting  results,  which  were  not  directly  related  to  the 
hypotheses  underlying  this  study.   First,  the  superiority  in 
quality  of  all  second  drafts  compared  with  all  first  drafts 
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Table    12 
ANOVA    TPStP 

of 

_Siaiiif icance    at    Six 

Levels 

Of 

Textual 

Complpxi1-y 

(Instructor 

Two) 

Source   of 
Variance 

Sum  of 
Scjuares 

Degrees   of 
Freedom 

Mean 
Scjuare 

F-Value 

Probability 

Surface  Level: 


Group 

.00012 

Topic 

1.72237 

Group   X   Topic 

.97638 

Word  Level: 

Group 

4.14050 

Topic 

8.73250 

Group   X   Topic 

4.44450 

Phrase   Level: 

Group 

2.21112 

Topic 

1.05138 

Group  X  Topic 

1.43737 

Clause  Level: 


Sentence  Level: 


00012 

.00 

57412 

1.54 

32546 

.87 

4.14050 

2.48 

2.91083 

3.80 

1.48150 

1.94 

2.21112 
.35046 
.47912 


1.90 
.33 
.45 


.99 
.21 
.46 


.13 
,02 
.14 


.18 
.81 
.72 


Group 

.02112 

1 

.02112 

.45 

.51 

Topic 

.21237 

3 

.07079 

1.30 

.28 

Group  X  Topic 

.14237 

3 

.04746 

.87 

.46 

Group 

.00012 

1 

.00012 

.00 

.98 

Topic 

1.34337 

3 

.44779 

3.17 

.03 

Group   X 

Topic              .32337 

3 

.10779 

.76 

.52 

Multisentence 

Level : 

Group 

14244.45347 

1 

14244.45347 

3.33 

.09 

Topic 

27417.32940 

3 

9139.10980 

2.59 

.06 

Group   X 

17556.68143 

3 

5852.22714 

1.66 

.19 

Topic 

1';- 
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was  statistically  significant,  supporting  the  assumption  that 
revision  generally  improves  the  quality  of  writing.   This 
finding  corroborates  Bridwell's  (1979)  finding  of  first-to- 
final  draft  quality  improvement,  but  contradicts  findings  by 
Beach  (1979),  Effros  (1973),  and  Onore  (1983)  whose  studies 
showed  no  improvement  in  essay  quality  after  revision. 
Second,  the  data  indicate  a  marked  difference  between  the  two 
instructors  in  terms  of  their  relative  success  in  eliciting 
multisentence  revision  from  their  students.   These  points 
will  be  discussed  in  Chapter  Six  following  a  discussion  of 
qualitative  findings  to  be  presented  in  Chapter  Five. 


r 


CHAPTER  FIVE 
QUALITATIVE  FINDINGS 


This  chapter  contains  findings  related  to  the  five 
research  questions  posed  in  Chapter  One.   Through  a 
comparison  of  specific  revisions,  written  revision  guide 
responses,  and  interview  responses,  the  researcher  hoped  to 
probe  behind  the  numbers  of  the  quantitative  analyses  in 
order  to  discern  the  practical  influence  the  experimental 
treatments  may  have  had  on  the  students'  revising  behavior 
and  attitudes  about  writing. 

This  chapter  is  divided  into  two  parts.   In  the  first 
part,  findings  derived  from  a  representative  sample  of 
specific  revising  behavior  and  written  revision  guide 
responses  will  be  discussed.   In  the  second  part,  student 
responses  to  the  target  questions  in  the  interviews  (see 
Chapter  Three)  will  be  presented  and  discussed.   Data  from 
the  two  instructors  will  be  discussed  under  separate 
headings . 

Specific  Revisions  and  Revision  Guide  Responses 

In  this  section,  the  specific  revising  behavior  of 
selected  students  will  be  presented  and  discussed.   In 
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addition,  this  section  will  include  the  researcher's 
perceptions  regarding  the  relationship  between  each  student's 
self-provided  or  peer-provided  written  revision  guide 
responses  and  the  revisions  made  by  that  student.   In  other 
words,  this  section  will  reveal  the  nature  of  the  students' 
responses  to  the  experimental  treatments  in  light  of  the 
following  research  questions: 

1.  What  will  be  the  nature  of  a  sample  of 
specific  revisions  made  by  students  on  first- 
draft  essays? 

2.  What  will  be  the  nature  of  a  sample  of 
specific  responses  made  by  students  to  the 
revision  guides  employed  in  this  study?    . 

These  two  questions  will  be  taken  up  together  so  that  the 

interrelationship  of  written  revision  guide  responses  and 

specific  revising  behavior  may  be  explored. 

Instructor  One 

Student  115*  raised  his  Sample  Essay  One  score  from  8  to 
14  through  the  application  of  68  revisions  in  a  950-word 
first  draft.   Fifty-six  of  these  revisions  were  at  the 
surface  and  word  levels,  and  none  involved  syntactic  units 
greater  than  a  clause.   This  student's  revising  behavior 


*Each  digit  in  the  student  identification  number  has  a 
specific  meaning.   The  first  digit  refers  to  the  student's 
instructor,  in  this  case  referring  to  Instructor  One.   The 
second  digit  refers  to  the  student's  treatment  group,  in  this 
case  self-evaluation.   The  third  digit  is  the  student's 
identification  number  within  the  treatment  group  for  that 
student's  instructor,  in  this  case  student  number  5. 
Similarly,  "student  226"  means  "Instructor  Two,  peer 
evaluation,  student  number  6." 
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amounted  to  an  extensive  "clean  up"  of  a  first  draft  that  was 
..  riddled  with  little  errors.   The  following  example 
illustrates  how  student  115  was  able  to  derive  a  considerable 
gain  in  holistic  score  from  the  careful  editing  of  his  first 
draft : 

First  draft:    I  had  always  done  well  in  sports  and 

aspirations  of  playing  professional 
football  was  my  goal. 

Second  draft:  I  had  always  done  well  in  sports  and 
playing  professional  football  was  my 
goal . 

The  deletion  of  the  phrase  "aspirations  of"  eliminated  a 

source  of  negative  response  by  the  holistic  ralters . 

Similarly,  this  student  changed  the  phrase  "teenage  guy"  to 

"teenage  youngster"  and  "thoughts  of  football  stardom"  to 

"thoughts  of  football  fame."   In  addition,  student  115 

introduced  many  correct  punctuation  marks  throughout  the 

essay,  adding  appreciably  to  its  readability.   None  of  these 

revisions  is  dramatic  taken  alone,  but  68  small  differences 

between  the  first  and  final  drafts  may  account  for  the  rise 

in  the  quality  score  assigned  by  the  holistic  raters. 

Student  115 's  written  response  to  the  revision  guide  for 

this  essay  in  no  way  predicted  any  of  his  revising  behavior. 

In  fact,  he  did  not  complete  the  activity  according  to  the 

directions  for  doing  so  given  in  class.   For  example,  in 

response  to  the  question  "What  is  this  essay's  greatest 

strength?"  student  115  wrote,  "lines  68-75;  82-2."   The  rest 
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of  this  student's  answers  to  revision  guide  items  were  also 
cryptic  or  unin format ive , 

In  contrast,  student  114 's  response  to  the  revision 
guide  for  Sample  Essay  One  indicated  that  the  guide  may  have 
had  an  effect  on  her  revising  behavior.   In  answer  to  the 
question,  "What  is  the  essay's  greatest  weakness?"  this 
student  wrote, "  I  felt  that  I  did  not  fully  cover  my  high 
school  years.   I  also  felt  that  more  information  should  have 
been  given  about  my  final  decision  made  with  my  parents." 
Student  114  did  not  act  on  the  idea  of  discussing  how  her 
parents  took  part  in  her  decision  to  attend  the  University  of 
Florida.   However,  her  final  draft  did  include  a  130-word 
multisentence  addition  which  provided  considerable  insight 
into  the  kinds  of  high  school  activities  which  contributed  to 
this  student's  acceptance  to  university.   Student  114  made  33 
other  revisions  in  her  820-word  first  draft.   These  also  may 
have  helped  raise  her  holistic  score  from  6  to  12,  but  the  ,. 
relatively  large  multisentence  addition  which  she  wrote  after 
having  given  herself  advice  to  do  so  on  the  revision  guide  , 
undoubtedly  played  a  part  in  raising  the  score  of  her  essay. 

Revising  a  620-word  first  draft  of  Sample  Essay  Two, 
student  111  suffered  a  loss  of  4  quality  points,  from  5  to  1 
through  the  application  of  27  revisions,  all  of  which  were  at 
the  surface,  word,  and  phrase  levels.   Although  many  of  these 
revisions  were  improvements,  others  represented  either  lapses 
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in  concentration  during  typing  or  an  inability  to  solve 

syntactic  problems,  as  in  the  following  example:       .  '' 

First  draft:    Success  or  moreover  what  a  success  is, 

can  be  difficult  if  even  possible  to  set 
in  definite  terms. 

Second  draft:   Success  or  what  success  is,  if  possible 
to  set  in  determinate  terms,  can  be  very 
difficult. 

Student  Ill's  second-draft  version  above  was  certainly  no 

improvement  over  the  first-draft  version.   Furthermore,  10  of 

this  student's  22  word-level  revisions  were  clearly  negative 

in  their  impact  on  quality.   They  were  all  typographic  errors 

and,  as  such,  could  be  thought  of  as  too  insignificant  to 

greatly  affect  the  holistic  scorers'  responses.   However, 

many  of  the  typographical  errors  interfere  with 

comprehension,  as  in  the  following  examples: 

In  the  United  States;  history  there  has  always  been 
this  striving  for  success.   (First  draft:   the     ^  .. 
semicolon  is  an  apostrophe,  and  "there"  appears  as 
"their.") 

People  is  today's  society  dream  of  being  wealthy 

and  successful.   (First  draft:   "People  in  today's   ,   '^ 

society.  .  .  .  ) 

Another  typographical  error  left  the  letter  "e"  standing  by 

itself  at  the  beginning  of  a  line  of  type.   Ten  such  errors 

probably  affected  the  ability  of  the  holistic  scorers  to 

comprehend  this  student's  text,  contributing  to  the  drop  in 

quality  score  from  the  first  to  final  draft.  ' 

Student  Ill's  revision  guide  responses  for  this  essay 

reflect  a  sense  of  satisfaction  with  a  job  well  done.   In 

answer  to  the  revision  guide  question  which  asked  students  to 


h-4  ' 


^X'\^ 


s^>^ 


106 

identify  the  method  of  development  employed  in  the  essay, 

student  111  offered  the  following: 

To  develop  the  definition  essay  the  writer  chose  to 
use  examples,  descriptions  of  attitudes,  and  the 
era  in  which  we  live  and  how  it  is  affecting  the 
views  that  society  has  in  general  about  success.   I 
agree  with  any  choice  of  method  any  author  uses  as 
long  as  it  is  clear  and  concise. 

The  glibness  evident  in  this  revision  guide  response  was 

typical  of  all  but  a  few  of  the  revision  guide  responses 

written  by  Instructor  One's  students,  both  self-evaluating 

and  peer-evaluating.   Students  congratulated  themselves  or 

each  other  for  a  job  well  done  in  the  case  of  the  poorest  as 

well  as  the  best  essays.   This  finding  may  indicate  that  the 

students  did  not  fully  comprehend  the  implications  of  the 

questions  and  directions  included  in  the  revision  guides. 

Alternatively,  some  students  may  have  been  conscious  of  the 

difficult  concepts  addressed  in  the  revision  guides,  but 

unwilling  to  grapple  with  those  difficulties  in  favor  of 

simply  fulfilling  their  revision  guide  assignments  with 

facile  responses.   In  either  case,  the  number  of  instances  in 

which  a  student  apparently  made  revisions  of  any  significance 

based  on  a  discernible  reaction  to  a  revision  guide  were 

exceptions  rather  than  the  rule.   Student  114 's  essay 

described  above  was  one  such  exception. 

Another  exception  was  student  123 's  revision  of  his 

Sample  Essay  Two.   Student  123 's  peer,  responding  to  his 

definition  of  success,  offered  the  following  advice  in  a 

revision  guide  response:   "Perhaps  specific  examples  that 
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come  from  personal  experiences  would  help  to  define 

'success.'"   Accordingly,  student  123 's  final  draft  included 

an  82-word  multisentence  addition,  as  follows: 

Many  students  often  find  that  they  are  not  making 
the  grades  that  they  feel  are  necessary  to  attain  a 
high-paying  job.   If  they  do  not  make  the  grades, 
then  they  feel  as  though  they  have  failed.   This  is 
not  true.   I  have  often  received  grades  that  I  felt 
were  not  high  enough  to  be  considered  "good 
grades."   It  felt,  however,  that  since  I  had  done 
the  best  I  could  do,  that  I  was  successful  in  my 
attempt  to  receive  high  grades. 

Student  123  made  only  10  other  revisions,  3  at  the 
surface  level,  6  at  the  word  level,  and  1  at  the  phrase 
level.   Therefore,  the  relatively  large  multisentence 
addition  to  student  123 's  500-word  first  draft,  inserted  on 
the  advice  of  a  peer,  may  have  contributed  to  the  3-point 
improvement  in  quality  score,  from  9  to  12,  earned  by  the 
final  draft  of  this  essay. 

An  additional  example  of  an  improvement  in  holistic 
score  achieved  through  revision,  this  time  unrelated  to  any 
revision  guide  response,  was  provided  by  student  121 's  Sample 
Essay  Three.   This  student  was  able  to  raise  the  score  of  his 
essay  from  a  6  for  his  690-word  first  draft  to  a  12  for  his 
final  draft,  through  the  application  of  19  revisions,  7  at 
the  surface  level,  8  at  the  word  level,  and  4  at  the  phrase 
level.   These  revisions  improved  the  essay  by  removing 
serious  errors,  thus  precluding  possible  negative  responses 
that  may  have  influended  the  holistic  scorers  to  assign  a  6 
to  the  first  draft.   Below  are  examples  of  the  improvements 
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student  121  made  in  his  Sample  Essay  Three,  a  discussion  of 
the  effect  of  condom-dispensing  machines  in  the  restrooms  at 
the  University  of  Florida. 


First  Draft 

A  percentage  of  Gainesville 
residents  feel  this  idea  is 
immoral,  and  wrong.   Not  only 
by  having  these  condoms  more 
accessible  reduce  sexually 
transmitted  diseases,  but  it 
will  also  most  likely  reduce 
a  number  of  pregnancies . 


Some  people  feel  this  is  an 
added  advantage  of  the 
machines,  while  one  group 
feels  this  is  very  wrong. 

Thus,  they  feel  there  is  no 
need  for  contraceptives, 
especially  not  a  University's 
campus . 


Second  Draft 

A  percentage  of  Gainesville 
residents  feel  this  idea  is 
immoral,  and  wrong,  not  only 
because  by  having  these 
condoms  more  accessible  will 
reduce  sexually  transmitted 
diseases,  but  also  because  it 
will  also  most  likely  reduce 
pregnancies . 

Some  people  feel  this  is  an 
added  advantage  of  the 
machines,  while  others  feel 
this  is  very  wrong. 

Thus,  they  feel  there  is  no 
need  for  contraceptives, 
especially  not  on  a 
University's  campus. 


As  these  examples  suggest,  student  121 's  final  draft  is  not 

free  from  problems,  but  it  is  practically  free  of  the  kinds 

of  crippling  breakdowns  displayed  in  the  first-draft  examples 

shown  above.   In  making  his  revisions,  student  121  was  not 

acting  on  any  advice  given  by  his  peer  through  the  revision 

guide.   The  following  example  illustrates  the  tone  and 

substance  of  the  peer's  revision  guide  responses: 

The  order  in  this  essay  is  ideal.   After  a  complete 
introduction,  [student's  name]  reveals  the  most 
important  causes  first,  such  as  disease  and 
pregnancy.   Then,  he  covers  the  effects  in  order  of 
importance  also.   He  states  the  opinions  of  the 
^,    church  and  the  public.   This  order  of  cause,  then 
•^    effects  is  perfect  for  this  paper. 
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Consistent  with  the  responses  given  by  nearly  all  the 
students  involved  in  this  study,  student  121 's  peer  offers 
only  the  most  benign  comments,  avoiding  the  more  difficult 
questions  concerning  what  the  writer  might  have  done 
differently  to  produce  a  better  piece  of  writing. 

Finally,  student  127  made  25  revisions  in  her  420-word 
first  draft  of  Sample  Essay  Four.   However,  the  result  was  a 
diminished  score,  from  11  to  7.   The  student's  grade 
reduction  may  have  been  the  result  of  four  glaring  instances 
of  carelessness  in  the  retyping  of  the  essay.   First,  she 
changes  "colleges  wrote  back  or  contacted  him"  to  "colleges 
wrote  back  of  contacted  him."   Next,  "did  not  receive  any 
type  of  reply"  is  changed  to  "did  not  receive  and  reply." 
Finally,  "white  people"  is  changed  to  "whit  people."   The 
rest  of  the  revisions  amount  to  no  more  than  superficial 
tinkering  with  details  in  the  text.   For  example,  8  of  the 
surface  level  revision  entailed  capitalization  of  the  first 
letters  in  the  phrase  "affirmative  action."   Therefore,  one 
may  conclude  that  the  careless  errors  noted  above  were 
sufficient  to  cause  the  holistic  raters  to  assign  a  lower 
score  to  this  student's  final  draft. 

In  the  revision  guide  responses  for  this  essay,  student 
127 's  peer  commented  approvingly  that  the  phrase  "white 
people  get  an  unfair  deal"  added  to  the  strength  of  the 
essay's  argument  against  affirmative  action  programs.   Yet, 
the  only  revision  above  the  phrase  level  made  by  student  127 
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was  the  deletion  of  the  sentence  in  which  this  phrase 
appeared. 

In  summary,  the  examples  presented  above  are  fairly 
representative  of  the  writing  of  Instructor  One's  students. 
Student  115  achieved  a  gain  in  holistic  score  through 
surface,  word,  and  phrase-level  revisions  which  were 
unrelated  to  his  revision  guide  responses.   Student  114 
achieved  a  gain  in  score  through  revision  which  included  a 
multisentence  addition.   This  multisentence  revision  was 
directly  related  to  one  of  her  revision  guide  responses. 
Student  111  suffered  a  loss  in  holistic  score  through  poorly 
applied  surface,  word  and  phrase-level  revision.   Her 
revision  guide  responses  expressed  satisfaction  with  a  job 
well  done.   Student  123  achieved  a  gain  in  score  through 
revisions  which  were  directly  related  to  a  peer's  advice  in 
the  revision  guide  response.   Student  121  ignored  the  advice 
of  his  peer  and  achieved  a  gain  in  holistic  score  through 
surface,  word,  and  phrase-level  revisions.   Finally,  student 
127  suffered  a  loss  in  score  through  poor  revising,  rejecting 
the  praise  of  her  peer.   As  these  findings  suggest,  the 
students'  responses  to  the  revision  guides  and  the  effect  of 
the  revision  guide  responses  on  revising  behavior  were 
idiosyncratic;  no  distinct  pattern  emerged.   Moreover,  the 
researcher's  overall  conclusion  was  that  there  was  no 
systematic  difference  between  the  treatment  groups  in  the 
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nature  or  effectiveness  of  either  revisions  or  revision  guide 
responses . 

Instructor  Two 

The  540-word  first  draft  of  student  214 's  Sample  Essay 

Two,  an  overly  general,  poorly  focused  extended  definition  of 

attractiveness,  received  a  score  of  6.   In  responding  to  the 

revision  guide  for  this  essay,  this  student  revealed  some 

dissatisfaction  with  various  aspects  of  her  first  draft.   For 

example,  in  response  to  the  revision  guide  question  which 

probed  for  an  evaluation  regarding  the  adequacy  of  the 

writer's  inclusion  of  context  and  background  in  the  essay, 

student  214  made  the  following  statement: 

Yes,  the  writer  supplies  a  context  or  background 
for  the  definition.   A  distinction  is  somewhat  made 
between  cultural  and  personal  definitions,  but  I 
think  I  wrote  much  more  on  the  cultural 
definitions.   I  should  therefore  put  my  personal 
definition  into  the  paper. 

To  a  question  on  developing  a  definition,  student  214  wrote 
as  follows: 

The  method  the  writer  used  to  develop  this 
definition  was  etymology,  examples.   I  agree  with 
this  choice,  but  I  need  to  add  more  connotations. 

Finally,  in  response  to  the  question,  "Is  the  definition 

given  in  the  essay  incomplete  in  any  way?"  the  student  wrote 

the  following: 

I  feel  the  essay  is  a  bit  incomplete.   I  need  to 
work  out  a  few  minor  details  and  give  more  examples 
of  attractiveness'  effect  on  different  people  and 
different  situations. 


*  * 
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Student  214  went  far  beyond  her  self-expressed  advice  to 
"add  more  connotations"  and  "work  out  a  few  minor  details." 
Her  final  draft  was  a  completely  new  essay  on  the  subject  of 
attractiveness.   The  final  version  applied  her  definition  to 
three  specific  examples — Christie  Brinkley,  Eddie  Murphy, and 
Oprah  Winfrey — showing  how  each  of  these  public  figures 
displays  attractiveness  in  a  form  which  radically  differs 
from  the  other  two.   Student  214 's  final  draft  received  a 
score  of  12,  an  improvement  of  6  points. 

Similarly,  in  her  revision  guide  response  student  219 
showed  dissatisfaction  with  her  first  draft  of  Sample  Essay 
Four,  an  argumentative  essay  focusing  on  affirmative  action 
programs.   This  600-word  first  draft  received  a  score  of  4. 
In  her  revision  guide  responses,  student  219  made  the 
following  statements: 

My  introduction  is  very  weak.  ... 

The  argument  and  explanation  for  affirmative  action 
is  very  minimal. 

The  logic  used  in  this  paper  is  very  reasonable  and 
does  support  the  position,  although  mi£h   more 
information  is  going  to  be  added. 

I  don't  do  a  very  good  job  countering  objections. 
I'll  fix  it. 

•    All  my  information  is  facts.   I  guess  it ' s  a  fault 
because  affirmative  action  is  an  emotional  subject 
depending  on  your  race.   Emotional  language  may  not 
be  necessary  but  it  could  improve  my  paper  if  I  can 
fit  it  in  well. 

This  student's  final  draft  is  a  complete  reworking  of 
the  essay.   Only  the  first  three  sentences  of  her  first  draft 
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are  carried  over  to  her  final  draft.   With  varying  degrees  of 
success,  student  219  attended  to  the  issues  she  raised  for 
herself  in  her  revision  guide  responses  and  produced  a  final 
draft  which  received  a  score  of  12  from  the  holistic  scorers. 

Student  225 's  610-word  first  draft  of  Sample  Essay  Two, 
an  extended  definition  of  success,  received  a  10  from  the 
holistic  scorers.   Had  this  student  been  ruled  in  her 
revising  behavior  by  what  appears  on  her  peer's  written 
revision  guide  responses,  she  would  have  made  no  revisions 
whatever  in  that  first  draft.   Student  225 's  peer  wrote 
nothing  but  glowing  commendations  on  her  first  draft,  saying 
that  she  supplied  adequate  context,  made  distinctions  between 
personal  and  cultural  definitions  of  success,  maintained 
appropriate  tone,  and  used  examples  well.   In  response  to  the 
final  revision  guide  question,  "Is  the  definition  given  in 
the  essay  incomplete  in  anyway?"  student  225 's  peer  wrote  the 
following  comment: 

No,  the  definition  is  not  incomplete.   She 
parallels  the  dictionary  definition  with  her  own 
and  supplies  an  example  for  each  case.   She  states 
many  of  her  own  beliefs  and  these,  together  with 
examples,  form  a  complete  definition. 

However,  student  225  chose  to  revise  her  essay 

substantially.   Her  second  draft  contains  at  least  one 

revision  at  each  of  the  six  levels  of  syntactic  complexity,  1 

at  the  surface  level,  10  at  the  word  level,  16  at  the  phrase 

level,  4  at  the  clause  level,  7  at  the  sentence  level,  and  6 
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at  the  multisentence  level.   One  of  her  multisentence 

revisions  is  a  new  beginning  for  the  essay,  as  follows: 

Visions  of  glamorous  men  and  women,  expensive 
cars,  and  dazzling  jewels  enter  the  mind  when  one 
defines  success.   Others  might  think  of  a  newly 
established  business,  graduation  day,  or  losing  ten   '.,•: 
pounds  when  considering  an  example  of  success. 

Student  225  then  presented  the  dictionary  definition  of 
success  which  began  the  first  draft.   The  new,  more  oblique 
beginning  quoted  above  was  more  engaging  and  softened  the 
impact  of  the  "stock  response"  dictionary-definition 
introduction. 

Student  225  also  substantially  revised  the  conclusion  of 

her  Sample  Essay  Two,  as  shown  below: 

First  Dcaft  Second  Draft  '   ^ 

Success  is  something  that  can    Success  is  something  that  can 
be  achieved  by  all.  be  achieved  by  all  in  one 

Definitions  of  success  vary     form  or  another.   By 
from  person  to  person.  rethinking  one's  definition 

However,  success  is  only  what    of  success  it  might  become 
one  makes  it .   The  level  of     evident  that  there  can  be 
success  can  be  measured  at      success  in  everyone.   Glamor 
lower  and  higher  levels         and  wealth  may  be  considered 
according  to  each  individual.    major  components  of  this 
Although  we  all  may  not         definition  to  some  but  to 
become  wealthy,  by  achieving    others  they  are  fragments 
our  goals,  we  are  a  success      among  other  parts, 
in  one  form  or  another.         Definitions  vary  among 

people,  especially  in  the 
abstract  word  success.   After 
reevaluating  the  definition 
of  success,  are  you  a 
success? 

Taken  together  with  the  new  beginning  added  to  the 

essay,  and  the  many  smaller  improvements  made  at  all   '•  •  ' 

levels  of  syntactic  complexity,  this  revised  ending 
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contributed  to  a  5-point  increase  in  holistic  quality  score, 
from  10  to  15. 

Student  227  chose  to  write  about  the  causes  and  effects 
of  gossip  for  her  Sample  Essay  Three.   Her  first  draft  began 
with  an  apparently  hypothetical  anecdote  about  a  woman 
overhearing  gossip  regarding  herself  at  a  party.   The  rest  of 
the  essay  offered  a  series  of  assertions  concerning  gossip, 
identifying  the  main  causes  for  this  pastime  as  boredom, 
selfishness,  jealousy,  and  the  desire  to  attract  attention  to 
oneself.   The  essay  went  on  to  state  that  gossip  may  cause 
misery,  the  breakdown  of  relationships,  and  even  tragedy. 

Student  227 's  first  draft  received  a  score  of  6  from  the 

holistic  scorers.   This  low  score  was  not  surprising,  since 

the  essay  offered  no  examples  to  illustrate  any  of  the 

assertions  made  about  gossip.   Moreover,  no  attempt  was  made 

to  connect  those  assertions  with  the  anecdotal  introduction 

of  the  essay.   Student  227 's  peer,  judging  from  the  advice 

offered  in  the  written  revision  guide  responses  for  this 

essay,  seemed  to  be  aware  of  the  fact  that  the  first  draft  of 

this  essay  was  not  entirely  successful: 

You  should  tell  how  each  type  of  gossip  has  a 
different  effect. 

She  has  mentioned  all  the  causes  I  can  think  of. 
Here  are  a  few  effects.   Loss  of  friends,  family 
separation  and  physical  damages  to  the  body  because 
of  gossip. 

She  really  doesn't  tell  what  effects  it  had  on  the 
host  of  the  party. 
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She  speaks  of  the  long  term  effects  it  may  have  on 
a  person.   She  doesn't  speak  of  any  short  term.   If 
you  would  put  in  a  few  short  terms  it  would  catch 
the  reader's  eye. 

Student  227  did  not  follow  the  well  intentioned,  if 
poorly  expressed,  advice  of  her  peer.   She  did,  however, 
revise  her  first  draft  at  all  six  levels  of  textual 
complexity,  including  over  500  words  of  revision  at  the  multi- 
sentence  level.   Her  second  draft  began  with  the  same 
anecdote  that  opened  her  first  draft,  but  the  rest  of  the 
essay  applied  her  thinking  about  gossip  to  a  novel  within 
which  gossip  figured  prominently.   The  result  was  a  final 
draft  that,  although  still  somewhat  disjointed,  rose  6  points 
to  a  score  of  12  following  revision. 

Student  222  wrote  a  first  draft  for  his  Sample  Essay 

Four,  an  argumentative  essay  about  affirmative  action 

programs,  and  received  a  score  of  15  from  the  holistic 

raters.   His  peer,  responding  to  the  revision  guide  question, 

"How  well  does  the  writer  counter  anticipated  objections  to 

his  or  her  own  arguments?"  raised  the  following  issue: 

You  mention  that  affirmative  action  is  unnecessary. 
Why  do  you  think  this?   It  is  not  effectively 
explained  in  your  paper. 

In  his  final  draft,  student  222  added  the  following 

introductory  paragraph,  responding  to  the  need  for  the 

clarification  identified  by  his  peer: 

Whites  constitute  eighty-seven  percent  of  the 
United  States'  citizens,  yet  less  than  thirty 
percent  of  the  player  jobs  in  the  National 
Basketball  Association  are  held  by  whites.   Is  this 
an  imbalance  that  should  be  corrected  by 
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affirmative  action  and  quotas?   Most  everyone  would 
agree  that  the  answer  is  "no."   However,  there 
continues  to  be  a  contrary  view  towards  percentage 
differences  in  other  professions. 

This  multisentence  revision  may  have  contributed  to  a  3-point 
increase  in  quality  score  to  18  for  the  final  draft  of  this 
essay,  the  highest  score  achieved  by  any  essay  collected  for 
this  study. 

In  summary,  as  was  the  case  with  Instructor  One's 
students,  revising  behavior  and  written  revision  guide 
responses  were  idiosyncratic  and  no  systematic  differences 
emerged  between  the  two  treatment  groups  in  terms  of  these 
data.   As  was  pointed  out  in  Chapter  Four,  Instructor  Two's 
students  revised  their  essays  at  the  multisentence  level  far 
more  frequently  than  did  Instructor  One's  students.   However, 
this  dramatic  difference  in  revising  behavior  was  not 
reflected  in  any  significant  differences  in  the  kinds  of 
revision  guide  responses  written  by  Instructor  Two's  students 
compared  with  those  of  Instructor  One.   With  few  exceptions, 
the  revision  guide  responses  written  by  Instructor  Two's 
students  were  glib,  superficial,  and  generally 
congratulatory . 

Furthermore,  no  correlation  emerged  between  multi- 
sentence  revising  and  improvement  in  holistic  scores  for 
essays  written  by  Instructor  Two's  students.   For  example,  of 
the  52  essays  whose  scores  changed  by  no  more  than  2  points 
from  first  to  final  drafts,  27  contained  at  least  one  multi- 
sentence  revision.   Therefore,  multisentence  revision,  by 
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itself,  was  not  a  determining  factor  in  those  essays  which 
did  improve  appreciably  from  first  to  final  drafts. 

As  was  the  case  with  Instructor  One's  students,  a  few  of 
Instructor  Two's  students  produced  examples  of  successful 
revision  which  were  related  to  written  revision  guide 
responses.   As  shown  above,  student  214  improved  the  score  of 
one  of  her  essays  through  large-scale  revision  related  to 
statements  she  made  on  her  revision  guide.   Student  219 
rewrote  an  essay  about  which  she  registered  dissatisfaction 
in  her  revision  guide  responses  and  improved  its  score. 
Student  225  ignored  the  glowing  praise  of  her  peer  and 
improved  the  score  of  her  essay  through  substantial  revision. 
Student  227 's  revision  guide  responses  expressed  a  need  for 
revision,  and  although  she  did  not  follow  the  specific  advice 
of  her  peer,  she  raised  the  score  of  her  essay  through 
extensive  revision.   Finally,  although  student  227 's  first 
draft  was  already  quite  successful,  he  followed  the  advice  of 
a  peer  to  improve  its  score  through  the  addition  of  a  multi- 
sentence  passage. 

Issues  related  to  the  differences  in  revising  behavior 
between  the  students  of  the  two  instructors  will  be  taken  up 
in  Chapter  Six. 

Student  Responses  to  Tnterview  Oupc;i- i  on?; 

In  this  section,  findings  related  to  students'  oral 
responses  during  tape-recorded  interviews  will  be  presented. 
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Of  the  20  students  from  each  instructor's  sections 
participating  in  the  study,  8  students  were  randomly 
selected,  4  from  the  self-evaluating  section  and  4  from  the 
peer-evaluating  section.   These  students  participated  in  a 
series  of  three  interviews,  each  of  which  took  place  within  a 
week  after  the  students  had  completed  the  final  drafts  of 
Sample  Essays  One,  Two,  and  Three,  respectively. 

The  purpose  of  the  interviews  was  to  probe  students' 
thinking  regarding  changes  that  may  have  occurred  in  their 
conceptions  of  revision  and  to  what  extent  the  assigned 
activities  helped  students  become  better  writers  of  academic 
prose.   Each  interview  was  based  on  an  unvarying  series  of 
questions  (see  Chapter  Three) ,  including  three  questions  of 
special  interest  to  the  researcher.   The  students'  responses 
to  these  "target  questions"  have  been  paraphrased  in  the 
tables  that  follow.   The  discussion  of  these  responses  will 
be  conducted  in  light  of  the  revision  and  revision  guide  data 
collected  from  the  interview  participants.   Data  from  the  two 
instructors  will  be  given  under  separate  headings. 

Students'  Self-Reports  of  Revising  Behavior 

The  findings  reported  in  this  section  are  related  to  the 
research  question  posed  in  Chapter  One:   "In  their  responses 
to  interview  questions,  how  will  a  sample  of  these  students 
characterize  their  own  revising  behavior?"   The  corresponding 
target  question  asked  of  each  interview  participant  was  "What 
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do  you  do  when  you  revise  your  first  draft?"   Interview 
participants  consistently  reported  that  they  made  revisions 
of  some  kind  in  their  first  drafts  before  submitting  their 
final  drafts  to  their  instructors. 

Instructor  One.   Table  13  contains  the  paraphrased 
responses  of  Instructor  One's  students  to  the  first  target 
question. 

These  results  are  consistent  with  the  fact  that 
Instructor  One's  students  generally  confined  their  revisions 
to  the  surface,  word,  and  phrase  levels  throughout  the  course 
of  the  study.   Students  114  and  116  maintained  a  conception 
of  revision  as  a  process  of  sub-sentence  error  detection  and 
correction.   They  considered  their  first  drafts  to  be 
artifacts,  not  as  tentative  reflections  of  their  thinking 
which  were  susceptible  to  large-scale  restructuring  or  even 
transformation  into  completely  new  configurations  of  content 
and  form. 

In  her  first  interview,  student  118  seemed  to  get  beyond 
the  spelling-punctuation-grammar  conception  of  revision, 
saying  that  she  read  through  her  first  draft  to  decide  "if 
the  style  is  right."   Unfortunately,  she  did  not  elaborate 
about  her  ideas  concerning  correct  style  for  an  academic 
essay.   Later  in  the  first  interview  she  offered  the 
following  comment  regarding  revision:  "Like  I'd  be  writing  it 
and  I'd  jump  back  and  make  another  paragraph  and  start 
another  paragraph.   I  remembered  something  important."   This 
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Table   13 

Student    Responses    to    the    Oupsl-inn.     "what    no    You    Dc   when    Ymi 
Revise    Your    First    Draff?"     (Tns1-rnptor    Qne^ 


SELF-EVALUATORS 

Student. 

114 


Interview   *1 
(October) 

Fix 

punctuation, 

spelling,    and 

change 

sentences 

around. 


Interview   »? 
(November) 

Check   for 

typos, 

grammar 

errors,    and 

smooth 

transitions 

between 

sentences. 


Interview    #'^ 
(December) 

Correct   typing 
errors,    verb 
agreement 
problems,    and 
the  basic 
grammar. 


116 


Correct  a  few 
things; 

eliminate  some 
things . 


Nothing  in 
depth.   Just 
corrections . 
Change  a  few 
word  orders. 


Not  necessarily 
revising.   Just 
review  for 
errors  and  take 
out  some 
sentences . 


118 


119 


Make  sure  it 
reads  OK  and 
check  spelling. 
I  add 
information. 


Pick  out  and 
correct  errors. 


Change 
paragraphs 
around. 
Change  whole 
sentences . 
Cross  out 
parts. 

Read  the 
whole  essay 
aloud.   If  it 
does  not  make 
sense  I  try 
to  improve  it . 
I  see  how 
each  thing 
fits  in. 


Fix  incomplete 
sentences  and 
spelling.   I 
don't  put  in 
more  detail. 


I  add  or  delete 
to  meet  the  word 
count 
requirement . 


Table  13 — Continued 


122 


PEER  EVALUATORS 
Student 

122 


123 


125 


Interview  #1 
(October) 

I  reread  and 
take  out 
anything  that 
is  totally 
absurd. 


I  check  for 
coherence;  then 
mechanics . 


I  change  two  or 

three 

sentences. 


Interview  »2 
(November) 

I  work  on 
specific 
sentences  and 
correct  all  the 
little  grammar 
errors . 


I  go  back  two 
times.   First  I 
read  for 
content;  then 
for  form. 


I  check  for 
typing  errors, 
and  then  to  see 
if  everything 
sounds  OK. 


Interview  #3 
(December) 

I  work  on 
being  as 
clear  as 
possible  the 
first  time, 
instead  of 
putting 
something 
down  and 
fixing  it  up 
later. 

I  have  two 
categories, 
content  and 
mechanics . 
First  I  do 
the  content 
and  then  the 
mechanics . 

I  look  for 
words  that 
sound  wrong. 
I  make  sure 
it's  logical 
and  follows 
a  pattern. 
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I  change  little 
things  as  I 
type. 


I  have  somebody 
else  read  it . 
I  change  words 
and  sometimes 
the  order. 


I  improve 
word  choice 
and  sometimes 
move  paragraphs 
around. 
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kind  of  revising  "on  the  run, "  so  to  speak,  is  an  example  of 
how  the  act  of  composing  served  to  stimulate  this  student's 
memory,  enabling  her  to  backtrack  and  add  relevant 
information  to  her  essay.   Her  final  draft  of  Sample  Essay 
One  corroborates  her  statement.   It  includes  a  new  paragraph 
of  three  sentences,  amounting  to  35  words. 

In  her  second  interview,  student  118  spoke  as  though  she 
had  completed  Sample  Essay  Two,  but,  in  fact,  she  never 
submitted  this  essay.   She  did  write  first  drafts  of  Samples 
Essays  Three  and  Four;  however,  she  did  not  revise  them. 
This  student's  responses  in  her  second  interview,  suggesting 
that  she  made  major  revisions,  contradicted  the  fact  that  she 
was  unable  to  complete  this  essay.   Regardless,  in  her  third 
interview,  student  118  returns  to  the  familiar  "fix  the 
little  errors"  depiction  of  revision. 

Student  119  appears  to  show  some  growth  in  his 
conception  of  revision,  moving  from  a  "pick  out  and  correct 
errors"  first-interview  response  to  reporting  a  more  whole- 
text  -based  approach  in  the  second  interview.   However,  later 
in  this  second  interview,  student  119  said  that  he  wrote  his 
first  draft  of  Sample  Essay  Two  "straight  through"  with 
apparently  little  or  no  pausing  to  consider  where  his  writing 
was  taking  him,  or  whether  another  direction  might  be  more 
promising.   In  the  third  interview,  this  student  revealed 
that  the  only  basis  upon  which  he  decided  to  add  or  delete 
significant  stretches  of  text  was  the  word  count  Instructor 
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One  set  as  part  of  the  assignment  for  the  essay.   If  he  had 

begun  to  expand  his  understanding  of  revision  by  the  second 

interview,  student  119 's  responses  in  the  third  interview 

certainly  showed  no  indication  of  continued  growth  along 

these  lines.   This  student  never  made  a  multisentence 

revision  in  any  of  the  four  essays  collected  from  him  for 

this  study;  his  post-first-draft  revising  remained  confined 

to  the  surface,  word,  and  phrase  levels. 

When  student  122  was  asked  if  he  ever  did  more  than  hunt 

for  spelling  errors  and  fix  the  way  his  essays  were  "worded, " 

he  offered  the  following  comment: 

Well,  usually  I  don't  transform  a  whole  paragraph 
or  move  a  section  from  one  place  to  another. 
Sometimes  I'll  say  a  point  after  the  fact  that  I've 
talked  about  that  point,  and  after  I  see  it, 
occasionally  but  not  very  often  I'll  move  it  or 
something  to  clarify  it. 

Except  for  this  occasional  reordering  of  points  which  flow 
out  in  the  wrong  order  during  his  first  attempt  at  composing 
an  essay,  student  122  remained  locked  into  a  spelling- 
punctuation-grammar  conception  of  revision. 

Student  123  entered  the  course  with  a  firmly  established 
two-stage  model  of  revision  in  his  mind  and  did  not  alter  his 
understanding  of  revision  one  iota  through  the  three 
interviews.   In  fact,  his  three  responses  to  the  question 
regarding  revising  shown  in  Table  6,  given  at  approximately  1- 
month  intervals,  were  nearly  identical.   First,  he  checked 
his  essays  for  content  and  coherence  of  presentation;  then, 
he  checked  for  spelling,  punctuation,  and  grammar  errors. 
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student  123 's  experiences  in  the  course  apparently  did 
nothing  to  shake  his  reliance  on  this  model  of  revision. 
Moreover,  his  revising  behavior  showed  that  he  never  found 
much  fault  with  the  coherence  or  mechanics  of  his  first 
drafts.   The  amount  of  revising  this  student  did  between  his 
pairs  of  submitted  drafts  went  from  small  to  nearly  non- 
existent.  His  Sample  Essay  Four  received  only  6  surface- 
level  revisions . 

One  exception  to  the  general  pattern  of  superficial 
thinking  about  revision  displayed  in  Table  13  is  student  125. 
His  response  in  the  third  interview  was  suggestive  of  an 
awareness  that  revision  may  extend  beyond  the  more 
superficial  features  of  an  essay.   He  spoke  of  evaluating  his 
essay  in  terms  of  logic  and  general  pattern.   It  is 
interesting  to  note  that  this  student  improved  the  score  of 
his  Sample  Essay  Four  from  8  to  12  through  revision, 
including  4  at  the  clause  level  and  2  at  the  sentence  level. 
Although  this  result  was  certainly  not  dramatic,  it  bears 
mentioning  since  it  suggested  some  growth  in  this  student's 
understanding  of  revision,  compared  with  his  responses  in  the 
first  two  interviews  and  his  revising  behavior  in  the  first 
three  sample  essays. 

Similarly,  student  120,  although  still  identifying 
revision  as  word  choice  in  her  third  interview,  also  said 

that  she  sometimes  moved  paragraphs  around.   Compared  with 

f  - 

her  first-interview  concept  of  revision,  "I  change  little 


things  as  I  type,"  student  120 's  third-interview  comment  may 
indicate  some  growth  in  her  understanding  of  revising. 

At  no  point  during  any  of  the  interviews  did  any  of  the 
students  mention  any  of  the  whole-text  issues  which  underlay 
the  revision  guides.   The  interviews  showed  little  indication 
of  any  carry-over  from  the  students'  work  with  the  revision 
guides  to  their  post-first-draft  revising  behaviors  as  they 
composed  their  assigned  essays.   For  example,  not  once  was 
any  concern  expressed  over  such  issues  as  audience 
expectations,  adequacy  of  background  information,  consistency 
of  tone,  division  of  concepts  into  categories,  or  methods  of 
essay  development. 

Instructor  Two.   Table  14  contains  the  paraphrased 
responses  of  Instructor  Two's  interview  participants  to  the 
first  target  question. 

Student  211 's  characterization  of  her  revising  behavior 
underwent  a  distinct  change  from  the  first  to  the  second 
interview.   In  the  first  interview,  she  described  her 
revising  process  as  a  matter  of  error  detection  and  minor 
adjustments  in  content.   Her  revising  behavior  on  Sample 
Essay  One  was  consistent  with  this  self-report.   She  made  32 
of  38  revisions  at  the  surface,  word,  and  phrase  levels.   The 
two  multisentence  revisions  she  made  amounted  to  44  words. 
Her  essay  lost  3  points  in  quality  score  following  revision, 
dropping  from  8  to  5 .   However,  in  her  Sample  Essay  Two, 
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Table  14 

Student  Respon.sf^.s  tn  thp  Quest-inn.  "What  Do  Ynn  no  Whpn  Yon 
Revise  Your  First  Draft?"  (Instrnotor  Two^ 


SELF-EVALUATORS 

Student-- 

211 


212 


218 


219 


Interview  #1 

Fix  run-ons  and 
fragments.   Add 
some  facts  and 
cut  out  some 
things . 


I  don't  have  a 
set  process.   I 
look  for  word 
choice 
improvement . 
Situate  and 
organize 
things . 


Fix  punctuation 
and  spelling. 
Change  a  few 
words  here  and 
there. 


Check  for 
content . 
If  I  forgot 
something, 
I'll  put  it 
in. 


Interview  *Z 

For  my  last 
essay  I 
rewrote  the 
whole  paper 
before  I  turned 
it  in. 

Cut  out  things 
and  make  word 
choices.   Look 
at  sentence 
structure. 
Maybe  add  a 
paragraph  if 
I 'm  not  up  to 
the  word 
count . 

Check 

punctuation 
and  shifts 
from  first  to 
second  to 
third  person. 
Add  more  or 
take  some 
away. 

I  read  my  first 
draft,  and  if 
it  confuses  em, 
I  change  it . 


Interview  *^ 

Maybe  change  a 
couple  of 
sentences. 
Cross  out  some 
things. 


Look  for  all  the 
grammatical 
errors.   Make 
word  choices. 
Try  to  make  it 
flow,  to  all 
work  together. 


Check  spelling, 
punctuation,  and 
make  minor 
changes . 


I  revise  as  I  go 
in  the  first 
draft,  and  then 
just  hand  it  in. 


Table    14 — Continued 
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PEER  EVALUATORS 

Student 
222 


224 


Interview  #1 

Check  sentence 
structure  and 
content.   Then, 
grammar  and 
spelling. 


I  revise  when 
the  flow  breaks 
down .   I 
concentrate  on 
grammar  and 
word  choices . 


Interview  42 

First  spelling, 
punctuation, 
and  sentence 
structure. 
Then,  context 
and  coherence. 


Look  at  word 
choice  and 
try  not  to 
sound  ignorant . 
I  pretend  I'm 
another  person 
when  I  read 
my  first 
draft . 


Interview  #3 

Check  sentence 
structure  and 
move  things 
around.   I 
might  change 
the  order  of 
paragraphs . 

I  don't  make  big 
changes .   I  make 
grammatical 
changes,  check 
sentence 
structure  and 
word  choice. 
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If 


226 


TAPE 

ACCIDENTALLY 

ERASED 


I  rewrite 
"stupid" 
sentences . 
change 
redundant 
words . 


Look  at 

sentence 

structure  and 

wording. 

Eliminate 

inappropriate 

sentences, 

even 

paragraphs . 

I  read  the 
whole  thing 
up  to  where  I 
am  and  revise 
things.   Then, 
while  I'm 
typing  I'll 
revise  a  little 
bit. 


Look  for 

misspellings  and 
errors;  then, 
grammatical 
things  and 
unnecessary 
sentences . 


Read  the  whole 
thing  over 
and  change 
words  or  fix 
the  grammar. 
Work  on  the 
way  one  point 
leads  into 
the  next 
point . 
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student  211  retained  only  a  few  sentences  of  her  first  draft 
and  submitted  a  virtually  new  essay,  raising  her  score  in  the 
process  from  4  to  11.   In  her  second  interview  student  211 
emphatically  made  mention  of  this  extensive  revision. 
Surprisingly,  in  the  third  interview  this  student  reported 
making  only  minor  changes  as  she  revised  Sample  Essay  Three, 
which  she  also  completely  rewrote,  producing  over  700  words 
of  multisentence  revision  on  a  first  draft  of  560  words. 
This  mismatch  between  student  211 's  description  of  her 
revising  behavior  and  the  record  of  extensive  revision 
available  to  the  researcher  caused  the  researcher  to 
reexamine  these  data.   This  reexamination  led  to  two  equally 
troublesome  conclusions.   First,  students  may  have  been 
giving  inaccurate  reports  regarding  their  revising  behavior. 
Secondly,  the  students  may  have  taken  the  researcher's 
question,  "What  do  you  do  when  you  revise  your  first  draft?" 
to  mean,  "What  revising  do  you  do  on  your  first  draft  before 
you  hand  it  in?"   Either  of  these  interpretations  of  the 
mismatch  between  student  self-reports  and  observed  behavior 
calls  into  question  the  usefulness  of  these  data.   To 
eliminate  the  second  conclusion,  the  researcher  should  have 
formulated  an  unambiguous  question  to  use  in  the  interviews. 

Student  212's  responses  through  the  three  interviews 
suggested  a  conception  of  revision  that  included  whole-text 
concerns.   His  response  in  the  first  interview  was  indicative 
of  his  thinking  about  revision: 
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I  just  kind  of  go  through  and,  things  that  I  think 
pertain,  if  I  find  something  that's  vague  or 
something  like  that,  I  might  scratch  it  out.   I 
just  go  through  and  do  a  lot  of  scratching  out,  a 
lot  of  writing  in,  and  try  to  situate  things, 
organize  them,  just  how  I  feel  like  it  sounds 
better,  just  better  to  me. 

Apparently  this  student  did  a  considerable  amount  of  revising 

before  submitting  his  first  drafts  to  class.   The  only  essay 

which  improved  more  than  one  point  from  first  to  final  draft 

for  student  212  was  Sample  Essay  Two.   This  essay  improved 

from  a  6  to  a  10  through  the  application  of  32  revisions, 

with  over  250  words  of  revision  done  at  the  multisentence 

level.   Student  212  also  revised  his  Sample  Essays  One  and 

Three  at  the  multisentence  level,  including  a  2  9-word 

addition  in  Sample  Essay  One  and  a  99-word  addition  in  Sample 

Essay  Three.   However,  his  score  on  Sample  Essay  One  improved 

only  1  point,  from  11  to  12  and  remained  at  15  in  Sample 

Essay  Three. 

Student  218  expressed  an  initial-interview  stance  on 

revising  which  characterized  that  process  as  no  more  than  a 

cursory  cleaning  up  of  a  set-in-cement  first  draft.   In  the 

second  interview,  this  student  stated  that  she  may  "add  or 

take  away  some"  but  offered  no  elaboration  to  indicate  why 

adding  or  deleting  language  might  be  important.   However,  in 

Sample  Essay  Two,  written  just  prior  to  the  second  interview, 

student  218  completely  rewrote  the  last  two-thirds  of  her 

first-draft  text,  improving  her  quality  score  from  10  to  15. 

Unfortunately,  in  the  third  interview,  student  218  returned 
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to  her  original  position  regarding  revision,  and  her  Sample 
Essays  Three  and  Four,  which  scored  9  and  10  in  their  final 
drafts,  respectively,  were  devoid  of  any  multisentence 
revisions . 

Student  219  was  unable  to  supply  specific  information 
about  how  she  revised  her  first  drafts  throughout  the  three 
interviews.   She  characterized  her  first-draft  revising 
behavior  as  a  matter  of  spotting  and  correcting  errors  as 
text  was  being  produced,  not  as  a  process  of  reviewing  an 
entire  text  in  order  to  discover  ways  in  which  that  text 
could  be  improved  as  a  whole.   Interestingly,  student  219  did 
apply  considerable  multisentence  revision  to  her  Sample  Essay 
Four,  amounting  to  a  complete  rewrite  of  that  essay,  and 
resulting  in  a  rise  in  score  from  4  to  12. 

Turning  to  Instructor  Two's  peer-evaluating  students, 

student  222 's  responses  in  the  first  interview  showed  a 

willingness  on  his  part  to  grapple  with  whole-text  issues  as 

he  composed  his  first  draft  of  Sample  Essay  One.   In  answer 

to  the  first  question  in  the  interview,  "How  do  you  go  about 

writing  an  essay?"  student  222  began  talking  in  terms  of 

revision  almost  immediately,  as  shown  in  the  following 

passage  from  the  transcript: 

Q:   OK,  first  of  all,  in  general,  this  is  a  really 
wide  open  question,  how  do  you  go  about 
writing  an  essay? 

A:   First,  I  think  about  the  topic,  and  then  I 

just  begin  writing,  and  then  rewrite  it  two  or 
three  times.   I  don't  write  an  outline  or 
anything  like  that. 
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Q:   Now,  you'll  write  a  whole  draft  and  then  look 
at  it  and  then  start  right  from  the  top  and 
write  a  second  draft? 

A:   Yeah,  pretty  much. 

Q:   And  then  that,  you  see  that  you  can  do  some 
things .... 

A:   Yeah,  right. 

Q:   OK,  from  the  first  draft  to  the  second  draft, 
what  kind  of  changes  do  you  make? 

A:   Pretty  much  sentence  structure  and  content. 

Q:   OK. 

A:   And  then  second  to  third  is  more  grammatical 
and  spelling. 

Q:   Does  the  form  of  the  essay  kind  of  set  like 

concrete  as  you  go  to  the,  in  other  words,  you 
wouldn't  completely  rewrite  it  in  the  third 
draft? 

A:   No.   I  probably  wouldn't. 

In  the  second  interview,  student  222  expressed  the  following 

characterization  of  revision: 

I  look  for  basic  grammatical  things:   spelling, 
sentence  structure,  punctuation.   I  look  for 
''  coherence,  context,  if  things  are  necessary.   Just 

the  general  paper. 

Similarly,  in  the  third  interview,  student  222  spoke  of 
"moving  things  around"  as  an  important  part  of  his  first- 
draft  revising  behavior.   Throughout  the  three  interviews, 
then,  student  222  described  his  conception  of  revision  as 
going  beyond  local  error  detection  and  correction.   He 
reported  that  he  routinely  wrote  more  than  one  draft  before 
handing  in  his  "first  draft"  to  the  instructor.   It  is 
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interesting  to  note  that  his  final  draft  scores  rose  steadily 

over  the  four  sample  essays:   from  12  to  13  to  16  to  18. 

Student  224  also  entered  the  course  with  some  ideas 

related  to  revision  that  went  beyond  sub-sentence  error 

correction.   Her  response  to  questions  concerning  the  way  she 

revised  her  first  drafts  before  handing  them  in  included  the 

following : 

I'll  rearrange  paragraphs  as  I  go  along.   And  I 
usually  try  to  skip  lines  so  I  can  write  stuff  in 
after  I  reread  it.   And  I  keep  on  adding  details 
in.   And  then  I'll  fix,  I'll  rewrite  it  with  all 
the  details  and  suggestions  I've  made  to  myself. 

In  her  second  interview,  student  224  spoke  of  showing  her 

writing  to  others  whom  she  sought  out  for  advice  and  of 

considering  revisions  they  suggested.   She  also  mentioned 

using  a  thesaurus  and  being  concerned  with  word  choice.   In 

her  third  interview,  student  224 's  answers  concerning  her 

first-draft  revising  behavior  changed  considerably  in  the 

direction  of  characterizing  her  approach  as  mainly  a  matter 

of  word  choice,  grammar,  and  sentence  structure,  as  shown  in 

the  following  excerpt : 

Q:   Do  you  revise  your  first  draft  before  you  hand 
it  in? 

A:   Yeah,  usually  once  or  twice. 

Q:   What  kinds  of  things  do  you  do  in  your 
revisions? 

A:   Mostly  I  don't  really  make  big  changes.   I 
make  grammatical  changes,  and  sentence 
structure,  word  choice  and  things  like  that. 

*-  '-    Q:   OK.   So  you're  looking  for  small  problems. 
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A:   Yeah. 

Q:   OK.   You  don't  find  yourself  redoing  it  or 
anything  like  that? 

A:   No,  not  usually. 

Q:   Do  you  ever  get  the  experience  of  crunching  it 
up  and  tossing  it  over  your  shoulder  and 
starting  again? 

A:   Yeah.   (laughing)   Yeah. 

Q:   But  it  doesn't  happen  that  you  get  all  the  way 
to  the  end  of  a  draft  and  look  at  the  whole 
thing  and  crunch  it  up  and  throw  it  away? 

A:   No. 

Unfortunately,  the  tape  containing  student  225 's  answer 

to  the  question  in  her  first  interview  regarding  first-draft 

revision  was  accidentally  erased.   However,  her  second  and 

third  interview  responses  indicated  a  conceptualization  of 

revision  as  the  correction  of  misspelled  words  and  the 

improvement  of  sentence  structure.   Paragraphs  might  be 

eliminated  if  they  were  found  to  be  redundant.   In  the  third 

interview,  student  225  responded  as  follows: 

Q:   What  do  you  do  when  you  revise  your  first 
draft? 

A:   Well,  first  I  write  it,  and  then  I  go  back  and 
I  look  for  misspellings  and  errors,  and  then  I 
go  through  and  look  for  grammatical  things  or 
sentences  that  might  have  been  repetitive,  or 
not  necessary. 

Q:   Right.   So,  cutting  out  maybe  a  little  bit. 
Have  you  ever  been  in  the  position  of 
rearranging  large  pieces  of  the  essay?   Or 
does  it  pretty  much  come  out,  because  you  were 
using  a  plan,  the  way  that  you  want  it? 

A:   It  pretty  much  comes  out  the  way  that  I  want 
it,  from  my  outline. 


y 
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Notwithstanding  this  last  comment,  student  225  made 
comprehensive  revisions  of  Sample  Essays  One,  Two,  and  Three 
at  all  levels  of  textual  complexity,  holding  her  score 
unchanged  at  12  for  Sample  Essay  One,  raising  it  from  10  to 
15  in  Sample  Essay  Two,  and  from  11  to  13  in  Sample  Essay 
Three. 

Student  226  retained  a  conception  of  revision  as  a 
process  to  be  applied  only  at  isolated  points  in  his  first 
drafts,  not  as  one  which  could  be  applied  in  a  holistic  way 
to  an  entire  text.   In  his  first  interview,  student  22  6  spoke 
of  recognizing  "stupid"  sentences  and  eliminating  them,  or  of 
realizing  that  a  particular  word  was  being  over-used  and 
changing  it,  or  of  switching  the  order  of  two  consecutive 
sentences.   Consistent  with  this  way  of  characterizing 
revision,  student  226  revised  only  one  of  his  sample  essays. 
Sample  Essay  Three,  at  the  multisentence  level,  and  then  only 
to  move  a  69-word  passage  to  a  new  position  in  the  essay. 
None  of  student  226 's  attempt  at  revision  were  particularly 
successful,  and  two  of  the  essays.  Samples  Essays  One  and 
Three,  declined  in  score  after  revision. 

In  summary,  the  data  regarding  these  students'  revising 
behavior  were  not  very  different  from  those  representing 
Instructor  One's  students,  notwithstanding  the  wide  gap 
between  the  students  of  the  two  instructors  in  terms  of  multi- 
sentence  revision.   At  no  time  did  the  researcher  get  a  sense 
that  Instructor  Two's  students  internalized  the  whole-text 
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concerns  underlying  the  revision  guides.   The  students 
consistently  characterized  revision  as  error-detection  and 
correction,  not  as  a  systematic  reappraisal  of  their  essays, 
resulting  in  fundamental  rethinking  and  reshaping. 

Student  Perceptions  of  Revision  Guides 

This  section  contains  a  discussion  of  responses  given  by 
the  research  subjects  to  the  second  target  question  in  the  .  . 
interviews.   That  question  was,  "What  effect  did  the  revision 
guide  activity  have  on  the  way  that  you  wrote  your  last 
essay?"   The  purpose  of  this  question  was  to  probe  into  the 
students'  perceptions  regarding  the  usefulness  of  the 
revision  guides  and  to  see  if  the  students  comprehended  the 
intent  of  the  guides.   That  intent  was  to  make  students  aware 
of  whole-text  concerns  as  they  considered  what  revisions  to 
make  on  their  first  drafts.   The  findings  reported  in  this       '^ 
section  are  related  to  the  following  research  question  posed 
in  Chapter  One:   "In  their  responses  to  interview  questions, 
how  will  a  sample  of  students  characterize  the  helpfulness  of 
the  experimental  treatments  they  experienced?"  .-,"j'> 

Instructor  One.   Table  15  shows  the  paraphrased 
responses  of  Instructor  One's  students  to  the  second  target 
question.   Student  114 's  response  in  the  first  interview  was 
of  the  holistic  scorers.   In  her  third  interview,  student  114 
acknowledged  that  she  did  reorder  her  paragraphs  in  response 
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Table  15 

Student  Responses  to  the  Question.  "What.  Effect.  Did  thp 
Revision  Guide  Activity  Have  on  the  Way  that  you  Wrote  Yonr 
Last  Essay?"  (Instructor  One^ 


SELF-EVALUATORS 

Student 

114 


Interview  »1 

It  made  my 
essay  better. 
It  was  a 
helping  guide, 


Interview  #2 

Not  much. 
I  pretty 
much  covered 
what  was  in 
there. 


Interview  ».3 

It  prompted 
me  to  change 
the  order  of 
my  paragraphs . 


116 


It  should  have 
made  me  do  some 
things,  but  it 
didn ' t . 


No  effect . 
I  saw  some 
things  that 
could  be 
changed,  but 
didn ' t  do 
anything  about 
them. 


I  didn't  change 
my  essay.   I  had 
satisfied  all 
the  items . 


118 


It  helped  a 
lot.   It  helped 
me  get  my 
thoughts 
straight . 


Not  much.   I 
satisfied  all 
the  items . 


It  gave  me 
needed  guidance. 


119 


It  clues  you 
in.   Doing 
the  activity 
made  the 
essay  sound 
like  it  was 
not  my  writing. 
My  essay 
became  less 
personal. 


It  made  me  look 
at  my  paper 
through  more 
critical  eyes. 


Not  much .   I 
satisfied  all 
the  items . 


;/>-■ 


Table  15 — Continued 
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PEER  EVALUATORS 

Student 
122 


Interview  *1 

It  wasn't 
too  helpful. 
My  peer 
seemed  afraid 
to  insult  me. 


Interview  #2 

The  quality  of 
the  essay  would 
have  been  the 
same  without 
it. 


Interview  #3 

My  peer  this 
time  gave  me 
some  good  ideas , 


123 


Teacher 
comments 
are  more 
important . 
ignored  my 
peer's 
comments . 


Some  effect . 
It  made  me  more 
critical  of  my 
writing. 


It  made  me  think 
I  was  doing  a 
good  job. 


125 


It  was  good. 
My  partner's 
advice  was 
helpful. 


Nothing  major. 
Teacher 
comments 
are  more 
important . 


No  effect .   It 
was  not  helpful. 


120 


It  did  not  help 
much. 


I  don't  use 
those  things . 
I  fill  them  out 
because  I  have 
to. 


No  effect .   ] 
don't  like 
working  with 
peers. 
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to  the  revision  guide.   Unfortunately,  the  outcome  of  her 
revisions  was  not  successful.   The  holistic  scorers  gave  the 
final  draft  of  her  Sample  Essay  Three  a  score  of  8  after 
having  given  the  first  draft  a  score  of  9. 

Student  116  was  well  aware  throughout  the  study  that  he 
was  not  responding  to  the  encouragements  to  revise  built  into 
the  course.   His  rejoinders  to  questions  about  his  thoughts 
concerning  revision  were  often  accompanied  by  laughter.   As 
his  comments  in  Table  15  suggest,  he  knew  he  could  have 
applied  considerably  more  effort  than  he  did  in  revising  his 
essay,  and  he  also  recognized  that  the  revision  guides  were 
asking  him  important  and  relevant  questions.   He  was, 
however,  unwilling  to  apply  the  necessary  effort. 

As  has  already  been  pointed  out,  student  118  was 
misrepresenting  herself  as  she  answered  questions  about  her 
revisions  and  her  reactions  to  the  revision  guide  activity, 
since  she  did  not  write  Sample  Essay  Two  and  did  not  revise 
Sample  Essays  Three  and  Four, 

Student  119 's  opinion  of  the  revision  guide  activity 
remained  positive  throughout  the  study.   This  student's 
response  in  the  first  interview  was  interesting  in  that  it 
showed  that  he  was  aware  that  the  course  he  was  in  was 
pushing  him  to  change  his  writing  style,  to  move  away  from 
the  casual  and  conversational  and  toward  the  impersonal  and 
formal.   When  asked  how  he  felt  about  this  pressure  to 
change,  student  119  did  not  offer  an  evaluative  comment  but 


^^- 
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said  only  that  it  surprised  him  not  to  be  able  to  recognize 
his  own  writing  when  he  had  finished  revising.   In  the  third 
interview,  student  119  stated  that  he  thought  his  first  draft 
of  Sample  Essay  Three  did  not  need  any  major  revision.   His 
revisions  of  this  essay  amounted  to  only  12  changes  at  the 
word,  phrase,  and  clause  levels.   His  essay  scored  9  and  10 
on  the  first  and  final  drafts,  respectively. 

Among  Instructor  One's  peer  evaluators,  student  122 's 
response  in  the  first  interview  was  representative  of  an 
important  difference  between  the  two  treatment  groups 
regarding  their  understanding  of  the  phrase  "revision  guide 
activity."   For  the  self-evaluators,  the  phrase  referred  only 
to  their  consideration  of  the  written  revision  guide  items, 
while  for  the  peer  evaluators,  the  phrase  also  included  their 
interaction  with  a  peer.   Several  times,  peer  evaluators  made 
no  mention  of  the  written  revision  guide  items  when  asked 
about  the  revision  guide  activity,  speaking  only  of  the 
effect  that  their  interaction  with  a  peer  had  on  their 
approaches  to  revision.   Student  122  said  nothing  about  the 
revision  guide  items  in  the  first  interview  but  spoke  only 
about  the  fact  that  his  peer  did  not  have  any  good  advice  to 
offer  about  how  to  improve  his  essay.   When  asked  whether  he 
thought  he  had  helped  his  peer  with  his  comments  about  her 
paper,  student  122  said  only  that  he  hoped  he  had  not 
insulted  her  with  is  criticism  of  her  style,  which  he  thought 
was  too  straightforward  and  simplistic.   In  the  second 
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interview  student  122  expressed  the  opinion  that  the  revision 
guide  had  no  effect  on  the  quality  of  his  paper  and  made  no 
mention  of  any  interactions  with  a  peer.   In  the  third 
interview,  however,  this  student  said  that  he  benefited  from 
the  revision  guide  activity,  since  his  paper  was  about 
athletics  and  his  peer  turned  out  to  be  an  athlete,  who  was 
able  to  react  to  his  writing  on  the  basis  of  personal 
knowledge .   When  asked  whether  the  revision  guide  items  were 
of  any  help,  student  122  characterized  the  revision  guide  as 
a  checklist  which  seldom  caused  him  to  think  of  needed 
revisions . 

Student  123  took  a  different  tack  in  his  experiences 
with  the  revision  guide  activities.   In  the  first  interview, 
he  stated  that  he  had  no  interest  in  his  peers'  comments, 
being  interested  foremost  in  his  instructor's  response 
concerning  his  writing,  and  secondarily  with  the  revision 
guides.   As  shown  in  Appendix  A,  all  four  of  this  student's 
essays  received  relatively  high  scores  from  the  holistic 
scorers.   Coincidentally,  as  his  comments  in  Table  15 
reflect,  this  student  gained  confidence  in  his  writing 
ability  as  the  semester  progressed.   Student  123  was  absent 
for  the  revision  guide  activity  corresponding  to  Sample  Essay 
Two  and  used  the  revision  guide  by  himself,  finding  it 
helpful  in  evaluating  his  own  writing.   In  the  third 
interview  this  student  stated  with  some  satisfaction  that  his 
first  draft  of  Sample  Essay  Three  earned  an  A  from  the 

9   V^    '   /■   .' 
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instructor,  who  made  only  two  or  three  minor  corrections  and 
that  his  peer  offered  nothing  but  praise  for  the  essay  during 
the  revision  guide  activity. 

Student  125 's  opinion  regarding  the  usefulness  of  the 
revision  guide  activity  grew  steadily  more  negative  over  the 
course  of  the  semester.   In  the  first  interview  he  said  that 
his  peer  offered  good  advice  on  the  basis  of  the  revision 
guide.   The  peer  helped  him,  he  reported,  to  combine  some  too- 
short  paragraphs  and  improve  his  diction  in  several  places. 
However,  in  the  second  interview  student  125  seemed 
unimpressed  with  both  the  revision  guides  and  his  peer's 
responses  to  them.   He  made  24  revisions  of  Sample  Essay  Two, 
all  involving  syntactic  units  below  the  sentence  level.   In 
the  third  interview  student  125  stated  again  that  he  was 
unaffected  by  his  peer's  reaction  to  his  essay  on  the  effects 
of  pollution  threatening  Florida's  reefs.   He  commented  that 
the  peer  did  not  know  anything  about  his  subject  and, 
therefore,  could  not  help  him  identify  any  information  he  may 
have  left  out  of  his  discussion. 

Student  120  remained  unfavorably  disposed  toward  the 
revision  guide  activity  throughout  the  semester.   In  the 
first  interview  she  declared  in  no  uncertain  terms  that  the 
revision  guide  activity  was  neither  interesting  nor  helpful. 
In  the  second  interview  this  student  offered  the  following 
illuminating  comment:   "It  seems  that  a  lot  of  things  [in  the 
revision  guide] ,  you  would  have  to  change  the  whole  paper  to 
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do  those  things."   Changing  a  whole  paper  was  an  option  to 
which  this  student  was  adamantly  opposed.   Furthermore, 
student  120  vehemently  expressed  the  opinion,  in  the  third 
interview,  that  peer  discussion  of  writing  is  a  waste  of 
time,  saying  that  she  would  not  listen  to  anyone's  advice 
unless  she  had  accepted  that  advisor  as  an  authority  figure. 
As  a  result,  the  peer  criticism  activity  was  of  no  help  to 
her.   When  asked  if  she  thought  she  had  been  of  any  help  to 
the  peers  she  had  been  paired  with,  she  said  that  she  did  not 
know,  that  the  discussions  had  been  perfunctory,  and  had 
concentrated  mostly  on  the  instructor's  comments  applied  to 
first  drafts. 

Instructor  Two.   Table  16  contains  the  paraphrased 
responses  of  Instructor  Two's  students  to  the  question,  "What 
effect  did  the  revision  guide  activity  have  on  the  way  that 
you  wrote  your  last  essay?"   Student  211 's  opinion  of  the 
revision  guide  activity  seemed  to  gradually  improve  over  the 
course  of  the  study.   In  the  first  interview  she  stated  that 
the  revision  guide  made  her  change  her  first  draft  "a  little 
bit,"  but  that  in  general  her  first  draft  had  satisfied  all 
the  revision  guide  items.   In  the  second  interview  she  stated 
that  the  revision  guide  had  been  instrumental  in  her  massive 
and  highly  successful  revision  of  Sample  Essay  Two,  although 
she  did  not  elaborate,  saying  only  that  she  worked  with  it  a 
little  and  that  "it  helped."   In  the  third  interview  student 
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Table   16 

Student   Responses  to  the  Onpstinn.    "Whai-   F.ffect.   Did  fhf 
Revision    Guide    Activity    Have    on    1-he    Way   that    Yon    Wrote    Yonr 
Last    Essay?"     (Tnstrno1-or    Twn^ 


SELF-EVALUATORS 


•■■<■    < 


Student 

Interview  #1 

Interview  #2 

Interview  #3 

211 

I  satisfied 

I  worked  with 

It  helped  me 

the  revision 

it  a  little. 

balance  my 

guide  items 

It  helped  me 

paragraphs  and 

in  my  first 

make  some 

improve  my 

draft.   Minor 

changes . 

introduction. 

effect. 

212 

I  can't  tell 

It  pinpointed 

It  pointed  out 

if  the  changes 

what  to  look  at 

what  the 

it  prompted 

in  revising. 

instructor 

me  to  make 

It  was  good. 

wanted. 

made  my  essay 

It's  hard  to 

better  or 

see  your  own 

worse .   The 

weaknesses.  ^ 

-■ 

•  ■       '   »" 

questions  were 

i 
0 

■>■:  : 

,  •  ■ '»   "  '  ■■ 

good. 

■  l   . 

218 

I  liked  seeing 

My  first  draft 

My  first  draft 

the  revision 

had  everything 

satisfied  all 

guide.   It  told 

the  revision 

the  revision 

» 

me  what  the 

guide  was 

guide  items. 

• 

teacher  wanted. 

looking  for. 

The  revision 

guides  have 

done  me  no 

good. 

219 

The  revision 

The  revision 

No  effect .   They 

guide  was 

guides  have  not 

don't  help  me. 

neutral  in  its 

had  much 

I  do  them 

effect. 

effect.   I  do 

because  I  have 

it  because  I 

to. 

have  to. 

Table  16 — Continued 
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PEER  EVALUATORS 


Student 
222 


224 


Interview  »1 

Not  much.   I 
don't  think  I 
learned 
anything  from 
my  peer. 


No  effect .   My 
partner  did  not 
want  to  take 
the  time. 


Interview  #2 

This  one  more 
than  the 
others. 
Reading  my 
peer's  paper 
helped. 

Not  much. 
My  peer 
talked  in 
circles . 
Other  revision 
guides  have 
been  better. 


Interview  #3 

Absolutely 
none .   My 
peer  just 
agreed  with 
everything  I 
had  done . 

It  helped  me 
improve  my 
introduction 
and  conclusion. 
My  peer  was 
helpful. 


225 


226 


The  idea  of  the 
revision  guides 
is  good,  but  it 
depends  on  the 
peer  you  get. 


I  do  what  the 
revision  guide 
is  asking  for 
anyway.   It 
validated  my 
work. 


I  had  a  bad 
peer  partner 
who  was  too 
uncritical. 
The  revision 
guide  items 
were  helpful. 

The  revision 
guides  have  not 
been  helpful. 


It  made  me 
realize  that  I 
had  not  included 
any  short  term 
effects.   It  was 
helpful . 


It  helped  me 
work  through 
long-term  and 
short-term 
time  frames . 
The  revision 
guide  activity 
has  good  and 
bad  points. 
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211  acknowledged  that  the  item  in  the  revision  guide  which 

asked  whether  the  causes  or  effects  under  discussion  in 

Sample  Essay  Three  had  been  well  defined  helped  her  improve 

the  introduction  of  that  essay.   Her  efforts  at  revision 

earned  a  2-point  improvement  in  the  score  for  her  Sample 

Essay  Three,  from  6  to  8.  r-  '  'r- 

Student  212  in  the  first  interview  expressed  a  certain 

degree  of  skepticism  regarding  the  efficacy  of  his  responses 

to  the  revision  guide.   His  paraphrased  statement  shown  in  >" 

Table  13  is  consistent  with  the  part  of  his  answer  to  an 

earlier  question  in  the  interview,  "How  do  you  know  when  an 

essay  is  finished?"   In  his  words:  ,  ,  .■ 

Occasionally  I've  typed  when  I  thought  it  was  done 
and  read  it  and  thought  of  some  things  that  I 
didn't  see  before  and  it  just  didn't  sound  right, 
and  of  course  when  I  had  the  time  where  I  could  do 
it  again  I  would  type  it  over  and  just  change  a 
paragraph,  two  lines,  whatever  needs  to  be  changed. 
But  it's  kind  of  hard  really  to  know  if  you've  done 
everything,  because  there's  always  going  to  be 
somebody  who  can  come  in  and  look  at  it  and  tell 
you,  "Well,  it  would  have  been  better  if  you  had 
done  this,"  like  when  you  hand  it  in  to  the 
teacher,  she  can,  no  matter  how  good  you  write  it, 
she's  going  to  find  something  you  can  improve  on 
because  you  can  get  better,  there's  no  doubt  about 
it.  .         ^. 

Student  212  said  he  did  not  feel  comfortable  handing  in  his 

first  draft  of  Sample  Essay  One  unchanged  after  the  revision 

guide  activity;  therefore,  he  forced  himself  to  make  some 

changes  (He  revised  the  essay  at  all  levels  of  syntactic 

complexity.)  and  hoped  they  were  improvements.   According  to 

the  holistic  scorers,  the  quality  of  his  essay  changed 
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little,  if  at  all,  earning  11  on  the  first  draft  and  12  on 

the  final  draft.   Student  212  was  emphatic  in  his  appraisal 

of  the  revision  guide  itself,  saying  that  it  contained  good 

questions  and  gave  him  good  ideas: 

It  was  a  reminder.   It  was  more,  it  might  have  been 
what  I  do  without  even  thinking  about  it,  but  it 

made  me  realize  what  I  was  doing.   So  it  gave  me 

some  ideas  to  answer  those  questions,  and  then  from 

there  I  could  look  at  that  and  see  what  I  said  in 

my  answers,  and  analyze  my  paper  is  what  it  boils 
down  to . 

Student  212  continued  to  ardently  express  the  opinion  that 

the  revision  guides  made  him  think  critically  about  his  first 

drafts,  and  the  doubt  about  whether  his  efforts  improved  his 

essays  disappeared.   The  scores  his  final-draft  essay  earned 

from  the  holistic  scorers  support  his  perception,  rising  from 

12  and  10  in  Sample  Essays  One  and  Two  to  15  in  both  Samples 

Essays  Three  and  Four. 

Student  218 's  first-interview  responses  to  questions 

regarding  the  revision  guide  activity  revealed  a  mildly 

negative  attitude  toward  the  instruction  this  student  was 

experiencing  in  ENC  1101.   Her  first  mention  of  the  revision 

guide  came  during  her  answer  to  the  question,  "How  do  you  go 

about  writing  an  essay?" 

Then  she  gave  us  a  revision  guide  which  we  had  to 
go  through.   And  I  just  found  a  couple  of  mistakes, 
where  she  wanted  us,  she  asked  us  for  facts  and 
figures,  and  I  had  plenty  of  them,  but  then  she  was 
asking  us  if  we  had  any  vague  ideas  or  some  things 
that  were  a  little  bit  vague,  so  I  clarified  them  a 
little  more. 


/  :  ■  ■  im. 

Later  in  the  interview,  the  following  exchange  took  place  as 

part  of  her  response  to  the  question,  "What  effect  did  the 

revision  guide  have  on  the  way  that  you  wrote  your  last 

essay?" 

Q:   Did  the  revision  guide  help  you  check  out  your 
essay,  kind  of? 

A:   Just  the  vagueness. 

-*■  ■ 

Q:  OK.  Did  the  questions  on  the  revision  guide 
or  the  directions  make  you  think  of  anything 
new  or  surprise  you  in  any  way? 

I. 
A:   No. 

Q:   They  were  kind  of,  "This  is  what  anybody  would 
ask  if  they  had  an  essay  of  this  type." 

A:  Well,  I  liked  seeing  the  revision  guide.  It 
made  me  think . 

Q:   Yeah,  it  gave  you  some  feedback. 

A:   Yeah.   It  gave  me  more  of  an  idea  of  what  she 
was  looking  for . 

-  Q:   OK. 

A:   What  she  was  looking  for.   Not  through  my 
work. 

» ,  Q:   Right,  there's  always  a  difference  between 
"what  I  want  to  say"  and  .  .  . 

A:   What  she's  looking  for. 

Student  218  agreed  that  "what  she  [Instructor  Two]  wanted" 

was  not  the  same  as  what  might  make  the  essay  a  better  piece 

of  writing. 

In  the  second  interview,  student  218 's  perceptions  of 

her  experience  with  the  revision  guide  activity  were  in  sharp 

contrast  with  the  outcomes  of  that  experience  reflected  in 
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the  revising  she  did  and  the  reaction  of  the  holistic  scorers 

to  her  efforts.   First,  here  is  the  relevant  section  of 

student  218's  second-interview  transcript: 

Q:   Now,  what  effect  did  the  revision  guide 

activity  have  on  the  way  that  you  wrote  the 
final  draft  of  that  essay? 

A:   It  really  didn't  have  any. 

Q:   OK. 

A:   I  didn't  like  the  revision  guide. 

Q:   OK,  you  had  to  write  answers  to  the  questions 
or  the  things  on  the  revision  guide,  but  was 
that  something  you  did  separately  and  handed 
in? 

A:   Well,  I  still  looked  at  it  and  thought  about 
it  before  I  made  my  final,  but  really  I  had 
everything  that  the  revision  guide  was  asking 
for,  so  I  really  didn't  need  to  go  back  and 
change  that  much. 

Q:   OK.   Did  it  make  you  feel  better  or  anything 
that  you  were  doing  the  assignment  correctly? 
You  looked  at  the  revision  guide  and  you 
looked  at  your  paper  and  you  said,  "I  think 
that  I  have  all  these  things." 

A:   Yeah,  it  made  me  feel  that  I  wrote  it  better 
the  first  time. 

Q:   Yeah,  but  it  didn't  make  you  change  anything 
on  the  essay. 

A:   Right. 

However,  a  comparison  of  her  two  drafts  of  Sample  Essay  Two 

showed  that  she  revised  at  all  levels  except  surface, 

including  more  than  500  words  at  the  multisentence  level. 

Furthermore,  Sample  Essay  Two  is  the  only  one  of  student 

218 's  four  sample  essays  which  improved  in  score  after 

revision,  rising  from  10  to  15.   This  student's  denial  of  the 


behavior  which  improved  this  essay  so  markedly  is 
inexplicable. 

In  her  third  interview,  student  218  repeated  the 
assertion  that  the  revision  guides  did  no  more  than  confirm 
to  her  that  she  had  satisfactorily  completed  the  writing 
assignments  for  the  course.   The  holistic  scorers  gave  a 
score  of  10  to  the  final  drafts  of  her  Sample  Essays  One, 
Three,  and  Four. 

Student  219  made  the  following  statements  in  her  first 

interview  when  asked,  "What  effect  did  the  revision  guide 

have  on  the  way  that  you  wrote  your  last  essay?" 

A:   Well,  it  made  me  go  back  and  make  sure  that  I 
had  specific  details,  and  that  I  didn't  put  in 
things  that  weren't  necessary,  and  it  made 
sure  that  I  had  a  persona,  like  a  certain 
person  was  talking,  and  just  made  sure  that  I 
went,  like  if  I  started  off  with  one  verb,  I 
didn't  switch  off. 

Q:   Right,  switch  off  to  another.   Did  you  feel 
that  the  revision  guide  was  helpful,  neutral, 
or  not  helpful. 

A:   More  like  neutral.   It  wasn't  really  that 
V,-    .,   helpful. 

Q:   In  other  words,  the  things  on  the  revision 

guide  were  things  that  you  already  would  have 
thought  of  anyway  on  your  own? 

A:   More  or  less,  yeah. 

Indeed,  student  219  did  not  substantially  revise  her  Sample 

Essay  One  and  received  scores  of  11  and  13  from  the  holistic 

scorers  for  her  first  and  final  drafts,  respectively. 

In  the  second  interview,  student  219  said  that  the 

questions  and  directions  in  the  revision  guide  were  too  vague 
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to  be  of  any  use  to  her  as  she  revised.   In  addition,  she 
stated  that  she  only  wrote  responses  to  the  revision  guide 
because  she  was  required  to  do  so.   Her  scores  for  the  two 
drafts  of  Sample  Essay  Two  were  6  for  the  first  draft  and  4 
for  the  final. 

Again,  in  the  third  interview,  student  219  said  that  the 
revision  guide  was  of  no  help  to  her  and  that  she  only  went 
through  the  motions  of  responding  to  it  because  it  was  part 
of  the  course  requirements.   Her  scores  for  Sample  Essay 
Three  were  7  and  9  for  the  first  and  final  drafts, 
respectively.   Unfortunately,  this  study  did  not  include 
interviews  following  Sample  Essay  Four,  since  it  was  due  in 
the  final  week  of  the  semester,  after  which  the  students  were 
no  longer  available.   Student  219 's  responses  to  the  revision 
guide  for  Sample  Essay  Four,  and  her  highly  successful 
redrafting  of  that  essay,  raising  the  score  from  4  to  12 
certainly  suggest  that  her  attitude  toward  the  revision  guide 
may  have  been  changing  as  the  course  came  to  a  close. 

As  was  the  case  with  Instructor  One's  peer-evaluating 
students,  those  of  Instructor  Two  often  emphasized  their 
interaction  with  peers  over  the  questions  and  directions  in 
the  revision  guides  when  evaluating  the  revision  guide 
activity. 

Student  222  stated  in  the  first  interview  that  he  did 
not  think  he  learned  anything  from  the  revision  guide 
activity.   His  peer,  he  reported,  "just  made  good  comments." 
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When  asked  if  he  thought  his  peer  benefited  from  his  conunents 
on  the  peer's  paper,  student  222  said, "Basically,  they  agreed 
with  my  decisions  where  it  was  unclear,  certain  words." 
Student  222  made  only  two  word-level  revisions  in  his  Sample 
Essay  One,  and  received  identical  scores  of  12  for  both 
drafts . 

In  the  second  interview  student  222  again  spoke  only  of 
his  interaction  with  a  peer,  not  the  conceptual  content  of 
the  revision  guide,  when  asked  about  the  effect  of  the 
revision  guide  activity  on  his  approach  to  writing  Sample 
Essay  Two.   This  time,  however,  his  response  was  quite 
positive;  he  reported  making  important  changes  in  his  essay 
on  the  basis  of  his  appreciation  on  the  way  his  peer  went 
about  the  assignment.   In  student  222 's  words,  "My  peer's  use 
of  examples  was  real  good.   It  made  you  know  what  it  was  to 
them."   The  record  of  student  222 's  revisions  shows  three 
multisentence  addition  in  Sample  Essay  Two.   The  score  of  his 
essay  did  not  rise  much  as  a  result.   It  received  a  12  for 
its  first  draft  and  13  in  its  final  form. 

In  the  third  interview,  student  222  returned  to  his 
negative  assessment  of  the  value  of  the  revision  guide 
activity.   He  said  that  his  peer  agreed  with  everything  he 
had  done  in  writing  the  essay  and  had  offered  nothing  but 
praise  for  it.   Student  222  reported  doing  almost  no  revising 
of  his  first  draft  of  Sample  Essay  Three.   The  record 
corroborates  his  statement.   The  second  draft  of  the  essay 
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shows  only  6  revisions,  3  at  the  word  level  and  3  at  the 

phrase  level.   However,  the  holistic  scorers  gave  the  second 

draft  a  score  of  16,  4  points  higher  than  the  12  assigned  to 

the  first  draft ,   Clearly,  this  is  one  case  in  which  the 

holistic  scorers'  judgement  concerning  the  quality  of  a 

second  draft  was  not  supported  by  the  quantitative  evidence 

of  that  revising  behavior.   It  is  difficult  to  accept  the 

idea  that  so  little  revising  could  result  in  such  an 

improvement  in  an  essay's  quality. 

Student  224  expressed  a  negative  opinion  concerning  the 

revision  guide  activity  in  the  first  interview.   She  said 

that  the  revision  guide  activity  had  no  effect  on  the  way  she 

wrote  Sample  Essay  One,  because  her  peer,  in  her  opinion,  did 

not  want  to  take  the  time  to  formulate  thoughtful  responses 

for  her  paper.   She  responded  to  some  follow-up  questions  as 

shown  below: 

Q:   You  think  if  you  had  answered  the  revision 
guide  questions  for  yourself  you  would  have 
answered  differently? 

A:   Yeah,  because  I  went  through  it  myself  later. 

Q:   Using  the  revision  guide? 

A:   Using  the  revision  guide  that  I  used  for  my 
partner. 

Q:   Did  it  help  you  think  about  your  own  paper? 

A:   Yeah,  it  did.   I  don't  think  it's  very  good 
when  you  switch  papers,  like  somebody  else 
.  ■      revises  your  paper  for  you  in  the  class, 

because  they're  just  trying  to  do  it  as  fast 
as  they  possibly  can.   It  was  all,  I  didn't 
\'t^\^.  find  anything  that  I  could  change,  that  was  a 

helpful  suggestion. 
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Q:   OK,  so  it  was  mostly,  "Yeah,  yeah,  it  was 
great,  leave  me  alone." 

A:   Right. 

In  the  second  interview,  student  224  again  reported  that 

the  revision  guide  activity  had  not  influenced  her  writing  of 

Sample  Essay  Two,  this  time  because  her  peer  "talked  in 

circles"  and  failed  to  give  her  any  specific,  useful  advice 

about  how  to  improve  her  essay.   Later  in  the  interview,  she 

offered  the  following  comments  about  her  experience  with  the 

revision  guide  activity: 

A:   Well,  I've  been  with  four  different  people, 
and  both  of  the  guys  had  nothing  to  say, 
neither  one  of  the  guys  that  got  my  paper  had 
anything  to  say  about  it . 

Q:   Do  you  think  that  there  is  any  chance  that  a 
guy  would  have  something  ... 

A:   Oh,  yeah,  sure,  I'm  sure  there  would  be,  but 

Q:   Not  these  two  guys.    '    •- > 

A:   These  particular  guys.  .  .  . 

Q:   OK,  but  let's  get  back  to,  so  the  two  guys 
weren't  too  helpful.   So  you  sat  with  two 
women . 

A:   Yeah,  one  of  the  girls  was  OK.   I  guess  she's 
an  average  student .   She  had  a  few  things  to 
say  to  me.   One  of  the  girls  was  really  smart 
and  she  gave  me  a  lot  of  helpful  ideas  on  the 
process  paper,  on  how  to  ride  a  bicycle,  and 
she  gave  me  a  lot  of  good,  helpful  suggestions 
about,  you  know,  filling  in  things.  - 

Q:   And  reasons  why  you  should?   Did  she  convince 
you  that  it  was  a  good  idea? 

A:   Yeah,  she  gave  me  reasons. 
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Q:  OK,  And  then,  do  you  think  that  the  one  girl 
that  made  all  these  comments,  did  it  have  any 
effect  on  the  quality  of  the  final  draft? 

A:  Yeah,  because  she  was  the  only  one  that  I  took 
any  of  the  suggestions. 

Q:  So  the  score  is  kind  of  one  good,  two  crummy, 
and  one  sort  of  neutral. 

...  A:   Yeah,  it  depends  on  what  type  of  student  they 
are . 

Q:   Yeah,  so  a  good  student  working  with  you  .  .  . 

;   *  A:   Right,  will  take  it  more  seriously. 

In  the  third  interview,  student  224  indicated  that  the 

revision  guide  activity  was  useful  and  helped  her  improve  her 

Sample  Essay  Three,  as  shown  in  the  following  excerpt  from 

the  transcript: 

Q:   What  effect  did  the  revision  guide  activity 

have  on  the  way  that  you  wrote  the  final  draft 
of  that  paper? 

A:   I  didn't  change  anything  in  the  body  in  any 
way,  except  for  a  few  things  that  were 
suggested,  word  choice  and  whatnot,  from  my 
partner.   But  I  changed  the  introduction  and 
the  conclusion.   The  introduction,  you  know,  I 
said  I  don't  like  my  roommate  because  of  this    .;  '■■ 
and  this  and  this,  but  I  didn't  really  make  it 
clear  that  it  was  because,  I  mean  I  didn't 
make  it  clear  enough  that  it  was  a  cause  and 
effect  paper.   It  didn't  sound  like  a  cause 
and  effect  paper  when  you  read  it .   It  just 
sounded  like  ... 

Q:  Now  did  that  come  from  looking  at  the  revision 
guide  and  then  looking  back  at  your  paper?  Or 
What?  Or  teacher  comments? 

Yeah,  I  had  a  good  partner  last  time.  '. 

Oh,  OK. 

I  stated  all  the  effects  but  never  really  said 
what  it  caused  me  to  feel,  I  guess. 


A: 

Q: 

ft-- 

A: 
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Q:   OK,  and  this  partner  was  like  right  on  to  some 

■    of  these  things .  , 

.1   ■  ■  .  - 

A:   Yeah. 
i.  .   Q:   And  gave  you  good  suggestions  about  that? 

A:   Yeah. 

■  *■ 

'  •    Q:   OK.   And  the  same  thing  with  the  conclusion? 

A:   Yeah. 

Q:   So,  it  had  a  significant  effect  on  how  the 
final  draft  came  out?   Going  through  the 
revision  guide  thing? 

A:   Yeah. 

The  record  shows  that  student  224  did  make  the  kinds  of 

changes  she  spoke  about  and  raised  the  score  of  her  Sample 

Essay  Three  from  11  to  13. 

Student  225 's  opinion  of  her  peer  partners'  feedback 
about  her  essays  remained  consistently  negative  throughout 
the  three  interviews.   In  the  first  interview,  student  225 
stated  that  her  peer  did  not  answer  the  revision  guide 
questions  adequately  and  therefore  did  not  help  her  to 
improve  her  essay.   However,  she  did  say  that  the  revision 
guides  were  useful  because  they  let  her  know  "what  the 
instructor  wanted"  in  an  essay.   She  used  the  revision  guide 
on  her  own  to  improve  her  final  draft. 

In  the  second  interview  student  225  said  that  the  peer 
she  had  sat  with  was  "another  bad  person  who  read  my  essay 
and  said  everything  was  good.  .  .  .  And  when  I  did  the  other 
person's  [paper]  I  was  as  hard  as  I  could  be,  because  I 
figured  that  was  going  to  be  the  best  help  for  them."   She 
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then  reported  that  her  roommate  in  the  dormitories  had  gone 
through  the  revision  guide  with  her,  had  been  more  critical, 
and  therefore  had  helped  her  make  improvements  in  her  essay. 

In  the  third  interview,  student  225  commented  that  her 
peer  partner  had  pointed  out  that  her  Sample  Essay  Three 
lacked  a  sufficient  discussion  of  short-term  effects.   She 
agreed  and  adjusted  the  essay  accordingly.   This  was  the  only 
positive  report  she  gave  of  her  interactions  with  peers 
during  the  revision  guide  activity  throughout  the  three 
interviews . 

Student  22  6  said  in  the  first  interview  that  his  peer 
had  correctly  pointed  out  a  vague  sentence  in  his  Sample 
Essay  One.   This  interaction  with  his  peer  led  student  226  to 
delete  the  sentence,  rather  than  rewrite  it.   As  for  the 
usefulness  of  the  revision  guide  itself,  student  226  said, 
"When  I'm  writing  my  paper,  I  do  almost  the  exact  same  things 
that  are  in  the  revision  guide,  so  there  wasn't  much  that  I 
saw  and  I  sort  of  edited  it  out  before  my  peer  even  saw  my 
first  draft."   Student  226 's  revision  if  his  Sample  Essay  One 
was  the  only  unsuccessful  one  among  Instructor  Two's  peer 
evaluators,  falling  in  score  from  13  to  10  after  revision. 

In  the  second  interview,  student  226  said  that  he  had 
been  away  at  a  track  meet  and  therefore  had  missed  his 
meeting  with  the  peer  assigned  to  him.   When  he  was  asked  for 
his  opinion  regarding  the  other  revision  guide  activities  he 
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had  participated  in  since  his  first  interview,  he  responded 

as  shown  below: 

A:   What  happens,  what's  been  happening,  we've 

been  doing  the  revision  guides,  and  no  one  has 
really  been,  you  know,  criticizing  it  enough 
to  really  change  it.   It's  like,  the  person 
will  say,  "Well,  you  could  have  put  more  of 
this  in."   So  I'll  put  a  little  more  of  that. 
And,  "You  could  have  do  a  little  more  with 
this,  a  little  more  with  that."   And  I'll  hand 
it  in,  but  barely  anything  has  changed. 

Q:   Do  you  usually  do  everything  the  other  person 
says  you  should  do? 

A:   Well,  I  consider  the  validity  of  what  the 

person  is  saying,  and  usually  that  person  is 
right  and  I  change  it,  but  in  most  of  my 
papers,  barely  anything  is  in  need  of  revising 
according  to  the  person  who  is  reading  the 
paper . 

Q:   OK,  so  it's  only  little  details. 

A:   Right. 

Q:   And  it  doesn't  change  the  overall  quality  of 
the  paper . 

A:   Not  at  all. 

Q:   OK,  all  right.   Do  you  have  any  feeling  about 
why  it  is  that  the  other  person  is  not  getting 
into  more  depth  with  talking  to  you  about  the 
paper? 

-   A:   I  don't  know,  I  just,  I  guess  no  one  really 
wants  to  burn  anyone  bad. 

Q:   Yeah.     -•  ■    '    ■   , 

A:   No  one  wants  to  tear  anyone  apart. 
Student  226  received  a  score  of  6  from  the  holistic  scorers 
for  both  drafts  of  Sample  Essay  Two. 

In  the  third  interview,  student  226  expressed  both 
positive  and  negative  opinions  related  to  his  experiences 
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with  the  revision  guide  activities.   He  said  that  he  was 

"able  to  find  a  lot  more  wrong  with  other  people's  papers 

than  they  are  able  to  find  with  my  papers.  ..."   He  went 

on  to  say  that  after  receiving  peer  responses  filled  with 

praise  for  his  first  draft  of  Sample  Essay  Three,  Instructor 

Two  "destroyed"  the  essay  with  her  response  to  it.   Later  in 

the  third  interview,  student  22  6  stated  that  he  would  prefer 

not  having  the  revision  guide  activity  for  the  reasons  shown 

below: 

Q:   Anything  else  about  the  whole  revision  guide 
activity?   Any  other  impressions? 

A:   I'd  rather  see  the  teacher  revise  it, 

personally.   Because  she's  the  one  who's 
giving  the  grade,  the  student  isn't. 

Q:   Absolutely. 

A:   So  that  you  may  do  revising  .  .  .  the  biggest 
danger  I  see  is  that  you  can  revise  something, 
something  the  teacher  would  have  liked,  into 
something  that  the  teacher  really  doesn't 
like. 

Q:   On  the  basis  of  some  student. 

A:   Right.   And  the  teacher  says,  "You  don't  have 
to  revise  if  you  don't  want  to,  if  you  don't 
think  the  point  is  valid."   And  you  revise  it, 
and  you  get  a  lower  grade.   That's  a  little 
hard  to  handle  .  :. 

Student  226  received  scores  of  6  and  5  for  his  first 

and  final  drafts  of  Sample  Essay  Three,  respectively. 

However,  his  Sample  Essay  Four,  which  he  revised  at  all 

levels  of  syntactic  complexity, earned  a  score  of  13  for  both 

drafts . 
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Student.  Pprr.ppt-inns  of  Their  Own  Improvement  as  Writers   ' 

The  final  target  question  in  the  interview  protocol  was 
included  to  ascertain  whether  students  perceived  the  course 
they  were  taking  as  an  effective  means  for  improving  the 
quality  of  their  writing.   The  question  asked,  "Has  anything 
changed  in  the  way  that  you  write  essays  as  a  result  of  the 
activities  you  have  experienced  in  ENC  101  this  year?"  was 
worded  as  neutrally  as  possible,  in  order  to  avoid  leading 
students  into  positive  responses  concerning  the  value  of  the 
course.   The  findings  reported  in  this  section  are  related  to 
the  following  research  question  posed  in  Chapter  One:   "In 
their  responses  to  interview  questions,  how  will  a  sample  of 
students  characterize  their  own  improvement  as  writers  over 
the  course  of  the  study?" 

Instructor  One.   Table  17  contains  the  paraphrased 
summaries  of  Instructor  One's  students  to  the  final  target 
question.   In  their  second  interviews,  all  but  one  of 
Instructor  One's  students  mentioned  revision  in  their 
answers,  saying  either  that  they  revised  more  or  that  they 
did  a  better  job  of  revising.   However,  in  their  third 
interviews  only  two  students  mentioned  revision.   The 
students  were  unanimous  in  their  opinion  that  the  course  had 
had  a  salutary  effect  on  their  writing  ability. 

Instructor  Two.   Table  18  contains  the  paraphrased 
summaries  of  Instructor  Two's  students  to  the  final  target 
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Table  17 

Student  Responses  to  the  Question,  "Has  Anything  Changed  in 
the  Way  that  You  Write  Essays  as  a  Result  of  the  Activities 
You  Have  Experienced  in  ENC  1101  This  Year?" (Instructor  One) 


SELF-EVALUATORS 

Student 
114 


Interview  #2 

I  write  better  now 
because  I  revise  more. 


Interview  *3 

I  don't  stray  off 
the  topic  or  write 
off  the  top  of  my 
head. 


116 


I  have  a  better 
attitude  about 
writing  now.   I  have 
more  intensity  when 
I  write.   I  revise 
more. 


My  writing  has 
inproved.   I  have 
more  confidence. 


118 


I  revise  more. 


I  have  improved 
through  practice. 


119 


I'm  understanding 
proper  tone  better, 
outline  more.   I 
revise  more. 


I  revise  much  more. 
I  have  never  done 
so  much  writing.    ' 
I  work  on  my 
introductions  more. 


PEER  EVALUATORS 
122 


I  try  to  impress  my 
peer  partner.   I  do 
more  in-depth 
revising.   I'm  not  so 
nonchalant . 


I 'm  much  more 
comfortable  with 
writing.   I'm  much 
more  careful  now. 


123 


I  revise  a  lot  more 
because  of  the 
revision  guides  and 
the  grading  system. 


Writing  is  just 
getting  easier  for 
me. 
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PEER  EVALUATORS 


Student 
125 


Interview  #2 

I  revise  more 

intensely,  with  a 
better  eye. 


Interview  #3 

I  use  the  cluster 
technique  now.   I 
now  write  in  the 
third  person.   I  have 
a  more  critical 
revising  eye. 


120 


I'm  more   relaxed  about 
writing.      Nothing  has 
really  changed. 


My  diction  has 
become  more   formal. 
I  make  conscious   word 
choices.      I  think 
more . 


question.      As   was   with  case   with   Instructor   One's    students, 
all   of   Instructor  Two's    students   who  were    interviewed 
expressed  the  opinion  that   they  had  improved  as  writers .      In 
their   second   interviews,    two   of   the   self-evaluators   and  two 
of   the  peer  evaluators  mentioned   revision   in   their   answers. 
In  the  third  interviews,    all  of  the   self-evaluators 
emphasized  the    fact   that   they  planned  their   essays   more 
carefully,    while   all   of  the  peer   evaluators   emphasized  the 
progress   they  had  made   in   theie   ability  to   successfully 
revise   their   essays. 
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Table  18 

Student  Responses  to  the  Question.  "Has  Anything  Changed  in 
the  Way  that  You  Write  Essays  as  a  Result  of  the  Activities 
You  Have  Experienced  in  ENC  1101  This  Year?"  (Instructor  Two) 


/A 


SELF-EVALUATORS 


Student 
211 


Interview  #2 

The  revision  part , 
The  RG  process 
helps  me  change  major 
ideas.   In  the  past,  I 
just  fixed  little 
things . 


Interview  »3 

I  think  more  and 
develop  topics  instead 
of  putting  in  extra 
stuff. 


212 


I  gather  more  info 
now.   I'm  more  into 
revising  now. 


I  have  a  better  idea 
of  prewriting.   I  a 
more  direct  and  to  the 
point  in  my  writing. 


218 


I  stay  in  the  same 
person  when  I  write 
now.   I'm  writing 
longer  papers . 
Otherwise  no  change. 


I  write  longer  essays. 
I  always  make  an 
outline  now. 


219 


I  think  before 
writing.   I  have  my 
roommate  read  my 
papers  before  I  hand 
them  in. 


I'm  more  careful  about 
grammar.  I  think  more 
before  I  write. 


PEER  EVALUATORS 
222 


I'm  pretty  much  the 
same. 


Not  much.   I  do  a  lot 
more  revising  now. 


224 


I  give  more 
examples .   I 
think  about  my 
audience  and  my 
classmates  reading 
it. 


I  take  much  more  time. 
I  think  about  my 
audience .   I  revise  a 
lot  more. 


m 
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PEER  EVALUATORS 

Student  .• 

225 


226 


Interview  #2 

I'm  not  so  complacent 
with  my  first  draft. 
I'm  aware  that  papers 
can  be  iitprove  by 
revision. 

I  think  more  before 
writing.   In  high 
school  I  would  just 
write  out  the  whole 
paper  in  one  shot . 


Interview  #3 

I  revise  much  more  and 
realize  that  it's  more 
than  just  changing 
little  things. 


I  think  I  structure  my 
papers  much  more  now. 
I  revise  much  more 
now. 


Summary 


Throughout  the  interviews,  the  students  of  both 
instructors  demonstrated  superficial  thinking  regarding 
revising.   Their  responses  to  questions  about  the  revision 
guides  were  equally  superficial,  remaining  confined  to 
unclarified  assertions  that  "they  helped"  or  "they  did  not 
help."   Although  Instructor  Two's  students  revised  much  more 
than  Instructor  One's  students  at  the  multisentence  level,  ' 
this  behavior  was  not  reflected  in  the  way  they  spoke  of  the 
revision  guides  or  of  revision,  compared  with  the  responses 
given  by  Instructor  Ones  students.   With  few 
exceptions  (student  212;  student  225,  third  interview; 
student  22  6,  third  interview)  students  confidently  declared 
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that  they  had  met  all  the  expectations  implied  by  the 

revision  guides.   They  showed  little  awareness  that  the 

revision  guides  were  pushing  them  toward  confronting 

!,    difficult  issues  in  their  texts.   Their  written  responses  to 
v" 

the  revision  guides  indicated  this  lack  of  awareness,  as  did 

their  self-reports  concerning  their  own  revising  behavior. 

Furthermore,  students  who  engaged  in  peer  interaction 

tended  to  speak  of  the  revision  guide  activity  only  in  terms 

of  the  persons  they  were  paired  with,  ignoring  altogether  the 

issues  and  concerns  raised  by  the  revision  guides.   For 

example,  if  they  perceived  that  they  had  been  paired  with 

"good"  partners,  then  they  reported  that  the  revision  guide 

activity  was  "helpful." 

In  general,  the  students'  interview  responses  regarding 

their  own  revising  behavior  and  the  helpfulness  of  the 

revision  guides  indicated  that  they  had  not  brought  well-    \ 

defined  conceptual  frameworks  related  to  revision  with  them 

from  high  school.   Moreover,  their  interview  responses 

strongly  implied  that  their  ability  to  articulate  an 

awareness  of  what  revision  entails  and  why  it  is  important 

did  not  improve  over  the  course  of  the  study. 

Notwithstanding  these  shortcomings,  all  but  one  of  the 

students  interviewed  stated  that  their  writing  ability  had 

improved  as  a  result  of  taking  freshman  composition.   These 

issues  will  be  discussed  in  Chapter  Six. 

li'-  ■ 
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CHAPTER  SIX 
CONCLUSIONS  AND  RECOMMENDATIONS 


This  study  was  designed  to  explore  the  relative  merits 
of  self-evaluation  and  peer  evaluation  as  instructional 
techniques  in  freshman  composition  classes.   Accordingly,  two 
experienced  instructors,  each  teaching  two  sections  of 
freshman  composition,  required  their  students  to  respond  in 
writing  to  revision  guides  following  submission  of  first 
drafts  of  assigned  essays.   For  each  instructor,  the  syllabus 
in  one  class  required  students  to  exchange  copies  of  first 
drafts  with  randomly  selected  peers,  write  revision  guide 
responses  for  each  other's  papers,  and  spend  class  time 
discussing  their  responses.   In  each  instructor's  other 
class,  students  wrote  revision  guide  responses  for  their  own 
first  drafts  and  spent  class  time  revising  their  own  papers. 
Except  for  this  difference  in  the  way  revision  guides  were 
used,  each  instructor  taught  her  two  sections  of  freshman 
composition  as  similarly  as  possible. 

To  test  the  effects  on  student  performance  of  this 
systematic  variation  in  instruction,  four  kinds  of  data  were 
analyzed.   First,  first  and  final  drafts  of  four  essays 
written  by  10  randomly  selected  students  from  each  of  the 
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four  treatment  groups  were  holistically  scored  by  raters  who 
were  unaware  of  which  papers  were  first  or  final  drafts. 
These  scores  were  submitted  to  ANOVA  procedures  to  test  the 
effects  of  three  variables:   treatment,  draft,  and  topic. 
Second,  all  revisions  made  by  these  40  students  were 
identified,  coded,  and  counted.   These  data  were  sorted  and 
assigned  to  six  levels  of  textual  complexity,  after  which 
ANOVA  procedures  were  applied  to  test  the  effects  of  two 
variables:   treatment  and  topic.   Third,  all  written  revision 
guide  responses  of  these  students  were  examined  by  the 
researcher  to  determine  whether  the  responses  of  self- 
evaluating  and  peer-evaluating  students  would  differ  in  any 
systematic  way.   Fourth,  four  of  the  ten  students  from  each 
section  were  interviewed  1  month,  2  months,  and  3  months 
after  the  start  of  the  study.   Their  perceptions  of  the 
experimental  treatments  were  tape-recorded,  transcribed,  and 
analyzed  in  light  of  the  data  obtained  from  the  examination 
of  their  written  revision  guide  responses  and  the  revisions 
they  made  in  their  essays. 

Conclusions  Related  to  Quantitative  Data      v;- 

Four  null  hypotheses  were  tested  through  quantitative 
analysis  in  this  study.   The  first  was  as  follows:   There 
will  be  no  difference  in  mean  holistic  score  between  first 
drafts  and  second  drafts  averaged  over  the  two  treatment 
groups  and  the  four  topics.   In  the  case  of  Instructor  One, 
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second  drafts  of  all  essays  were  assigned  significantly 
higher  holistic  scores  (p  <  .0002)  than  first  drafts.   In  the 
case  of  Instructor  Two,  the  main  effect  of  the  Draft  variable 
shown  in  the  ANOVA  was  also  significant  (p  <  .0001)  . 
Therefore,  the  first  null  hypothesis  may  be  rejected.   This 
result  provides  strong  support  for  the  inclusion  of  required 
revision  as  part  of  composition  instruction. 

The  second  null  hypothesis  was  as  follows:   There  will 
be  no  difference  between  the  two  treatment  groups  in  terms  of 
the  degree  of  change  in  holistic  score  from  first  draft  to 
final  draft;  i.e..  there  will  be  no  draft -by-treatment 
interaction.   Regarding  this  hypothesis,  the  results  of  the 
ANOVA  analysis  were  the  same  for  both  instructors:   No 
treatment  effect  occurred.   In  other  words,  neither  treatment 
was  superior  to  the  other  in  promoting  improvement  in 
holistic  score  from  first  to  second  drafts.   The  practical 
conclusion  which  may  be  drawn  from  the  retention  of  the 
second  null  hypothesis  is  that  this  study  provides  no  basis 
for  preferring  either  independent  use  or  peer-interactive 
use  of  the  kinds  of  revision  guides  employed  here. 
Therefore,  writing  teachers  may  have  confidence  in  both 
strategies  as  positively  affecting  students'  development  in 
composition. 

The  third  null  hypothesis  tested  was  the  following: 
There  will  be  no  difference  among  the  mean  holistic  scores 
achieved  on  each  of  the  four  different  topics  addressed  in 
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the  students'  essays.   In  the  case  of  Instructor  One,  the 
Topic  variable  showed  no  significant  effect  on  holistic 
score.   In  the  case  of  Instructor  Two,  the  Topic  variable  had 
a  significant  effect  (p  <  .03)  on  holistic  score,  indicating 
that  Instructor  Two's  students'  holistic  scores  may  have  been 
affected  by  the  different  topics  they  were  assigned  to  write 
about . 

The  fourth  null  hypothesis  tested  in  this  study  was  as 
follows:   For  each  of  six  levels  of  textual  complexity^  there 
will  be  no  difference  between  the  two  treatment  groups  in 
terms  of  the  amount  of  revision  in  students'  essays.   The 
researcher's  chief  interest  in  this  aspect  of  the  study  was 
to  determine  whether  either  of  the  treatments  would  promote 
more  revising  at  the  sentence  and  multisentence  levels. 
Greater  amounts  of  revising  at  these  levels  would  suggest 
that  students  were  doing  more  than  simply  tinkering  with  the 
details  of  their  essays  during  revision.   The  ANOVA  analyses 
run  on  the  revision  data  showed  no  significant  difference 
between  the  treatment  groups  of  either  instructor  in  terms  of 
the  amount  of  revising  they  did  at  six  levels  of  textual 
complexity.   Therefore,  the  fourth  null  hypothesis  may  be 
retained.   The  practical  conclusion  which  may  be  drawn  from 
this  result  is  that  this  study  offers  no  support  for  the 
perception  either  that  individual  use  of  revision  guides  such 
as  employed  here  will  promote  more  large-scale  revision  by 
students  than  peer-interactive  use,  or,  vice  versa,,  that  peer- 
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interactive  use  of  such  revision  guides  is  superior  in 
promoting  revision.   Teachers  may,  therefore,  use  either  or 
both  methods  as  part  of  writing  instruction. 

Beyond  the  four  hypotheses,  another  interesting  finding 
emerged  as  a  by-product  of  the  statistical  analysis  of  the 
students'  revising  behavior.   Instructor  Two  was  far  more 
successful  at  eliciting  multisentence  revision  from  her 
students  than  was  Instructor  One.   Over  the  course  of  the 
study.  Instructor  Two's  students  made  175  multisentence 
revisions  (self-evaluators,  88;  peer  evaluators,  87),  while 
Instructor  One's  students  made  only  28  such  revisions  (self- 
evaluators,  18;  peer  evaluators,  10) .   This  dramatic 
difference  in  multisentence  revising,  not  between  the  two 
treatment  groups,  but  between  the  students  of  Instructor  One 
and  those  of  Instructor  Two,  suggests  the  strong  influence 
the  instructor  always  has  over  the  outcome  of  any 
instructional  program.   After  the  researcher  became  aware  of 
the  great  difference  in  the  amount  of  multisentence  revising 
across  the  two  instructors,  he  talked  with  each  of  them, 
seeking  their  perceptions  regarding  possible  sources  of  this 
difference.   Neither  instructor  was  able  to  state 
specifically  why  she  thought  the  difference  had  occurred. 
However,  one  difference  in  the  two  instructors'  grading 
policies  should  be  recalled.   Instructor  One  graded  and 
commented  on  the  first  drafts  of  all  essays  before  students 
'f     engaged  in  the  revision  guide  activity.   Students  in 
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Instructor  One's  classes  were  told  that  their  revised  drafts 
could  earn  no  more  than  a  one-third  letter  grade  improvement 
in  mark.   For  example,  the  best  that  a  student  could  hope  for 
in  revising  a  C+  essay  was  a  B- .   In  contrast.  Instructor  Two 
graded  and  commented  only  on  final  drafts.   These  differences 
in  grading  and  commenting  policies  may  not  be  conclusively 
related  to  the  differences  in  the  students'  revising 
behaviors,  but  it  is  worth  noting  that  students  who  received 
no  grades  or  comments  on  their  first  drafts  did  more  revising 
at  the  highest  level  of  textual  complexity  than  did  students 
who  may  be  perceived  as  working  for  a  predetermined  and 
modest  increase  in  grade.   This  powerful  effect  of  grading  V 
procedures  and  policy  on  revising  behavior  is  deserving  of  ,,. 
further  research. 

Conclusions  Related  to  Qualitative  Data 

In  addition  to  the  three  hypotheses  tested  by 
quantitative  means,  this  study  included  a  qualitative 
component.   The  researcher  examined  all  the  revisions  made  in 
the  student  essays  he  collected,  read  the  written  revision 
guide  responses  corresponding  to  these  essays,  and 
interviewed  a  random  sample  of  students.   The  interviews  were 
tape-recorded  and  transcribed;  the  researcher  read  these 
transcripts  and  abstracted  from  them  tables  of  paraphrased 
responses  to  the  target  questions  in  the  interviews.   These 
qualitative  data  were  applied  to  five  research  questions. 
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The  first  question  was  as  follows:   What  will  be  the  nature 
of  a  sample  of  specific  revisions  made  by  students  on  first- 
draft  essays?   Concerning  this  question,  the  only  general 
pattern  to  emerge  was  the  above-mentioned  difference  in  multi- 
sentence  revision  between  the  students  of  the  two 
instructors.   Except  for  this  difference,  the  researcher's 
examination  of  specific  revisions  uncovered  no  consistent 
pattern.   In  other  words,  the  students'  revising  behavior 
remained  idiosyncratic  throughout  the  study.   Although  the 
revision  guides  may  have  contributed  to  the  generally 
improved  scores  on  final  drafts,  no  patterns  in  the  students' 
specific  revisions  were  found  which  might  have  contributed 
support  for  this  speculation. 

The  second  research  question  explored  in  this  study  was 
the  following:   What  will  be  the  nature  of  a  sample  of 
specific  written  responses  made  by  these  students  to  the 
revision  guides  employed  in  the  study?   As  was  pointed  out  in 
Chapter  Five,  the  most  common  type  of  written  revision  guide 
response  was  congratulatory.   All  40  students  generally   .. 
followed  what  may  be  seen  as  "the  line  of  least  resistance" 
in  responding  to  the  revision  guides.   They  uncritically 
commended  themselves  or  each  other  for  first  drafts  that  the 
holistic  scorers  rated  low.   Only  rarely  did  students  offer 
well-deserved  praise  or  insightful  suggestions  for 
improvement.   One  must  conclude,  therefore,  that  the  revision 
guide  activity  did  not  achieve  its  intended  effect.   Possible 
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reasons  for  this  failure  on  the  part  of  the  revision  guides 
will  be  discussed  below. 

The  third  research  question  addressed  in  this  study  was 
as  follows:   In  their  responses  to  interview  quest  ions ^  how 
will  a  sample  of  these  students  characterize  their  own 
revising  behavior?   The  researcher  found  no  systematic 
difference  between  the  treatment  groups  assigned  to  either 
instructor.   Instructor  One's  students  restricted  their 
comments  to  surface,  word,  and  phrase  problems  in  7  of  24 
responses.   Instructor  Two's  students  did  so  in  7  of  23 
responses  (one  response  was  accidentally  erased  and  lost) . 
None  of  the  16  students  interviewed  articulated  comprehensive 
understanding  of  audience  needs,  overall  text  structure, 
tone,  completeness,  or  other  whole-text  issues.   They 
appeared  to  lack  the  kinds  of  cognitive  benchmarks  by  which 
successful  writers  assess  the  quality  of  early  drafts  and 
identify  elements  of  text  requiring  revision.   Issues  related 
to  this  result  will  be  discussed  below. 

The  fourth  research  question  concerned  the  students' 
assessment  of  the  revision  guide  activity  and  was  stated  as 
follows:   In  their  responses  to  interview  questions,  how  will 
a  sample  of  these  students  characterize  the  helpfulness  of 
the  experimental  treatments  they  experienced?   In  general, 
the  students'  assessment  of  the  revision  guide  activity, 
regardless  of  instructor  and  regardless  of  treatment,  was 
negative.   Thirty-two  of  the  48  responses  addressing  this 
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research  question  characterized  the  revision  guides  as  not 
helpful.   Moreover,  the  16  responses  which  characterized  the 
guides  as  helpful  were  either  vaguely  stated  (e.g.,  "It 
helped  me  get  my  thoughts  straight"),  or  based  on  the 
perception  that  the  guides  helped  the  student,  "see  what  the 
teacher  wanted, "  or  based  on  the  fact  that  a  peer  had  been 
helpful.   These  responses  suggest  that  the  revision  guides 
were  not  an  important  factor  in  the  general  improvement  of 
all  essays  from  first  to  final  drafts. 

The  fifth  research  question  was  stated  as  follows:   In 
their  responses  to  interview  questions,  how  will  a  sample  of 
these  students  characterize  their  own  improvement  as  writers? 
All  but  1  of  the  16  students  interviewed  asserted  that  they 
believed  they  had  improved  as  writers.   Six  of  them 
explicitly  stated  in  the  final  interview  that  they  had 
learned  to  revise  more  effectively.   However,  analysis  showed 
that  the  students'  revising  behavior  did  not  change 
appreciably  during  the  study. 

Discussion 

In  this  study,  although  some  essays  did  decline  in 
holistic  score  from  first  to  final  drafts,  revision  was  found 
to  have  a  statistically  significant  positive  effect  on  essay 
quality,  regardless  of  treatment  or  instructor.   This  result 
was  consistent  with  the  findings  of  Buxton  (cited  in 
Braddock,  Lloyd-Jones,  &  Schoer,  1963)  and  Bridwell  (1979), 
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but  counter  to  the  findings  of  Beach  (1979),  Effros  (1973), 
and  Onore  (1983)  ,   Furthermore,  in  this  study  neither  the  use 
of  revision  guides  by  individual  students  working  alone  nor 
their  use  by  pairs  of  students  working  on  each  other's  essays 
proved  to  be  superior  in  promoting  improvement  in  holistic 
score  from  first  to  final  draft.   This  result  was  consistent 
with  the  findings  of  Carter  (1982),  Graner  (1987),  and 
Pierson  (1967) .   One  of  the  researcher's  goals  in  undertaking 
the  present  study  was  to  see  if  the  foundation  for  claims 
favoring  peer  evaluation  made  in  the  professional  literature 
(Bruffee,  1974;  Elbow,  1981;  Legana,  1972;  Moffett,  1968; 
Nystrand,  1986  and  1989)  could  be  strengthened  through 
further  controlled  research.   The  findings  in  the  present 
study,  however,  did  not  provide  such  support.   Furthermore, 
neither  self-evaluation  nor  peer  evaluation  as  defined  in 
this  study  was  superior  in  promoting  sentence-level  or  multi- 
sentence-level  revision.   In  his  review  of  the  literature, 
this  researcher  found  no  other  study  with  findings  on  this 
point . 

Other  interesting  findings  in  this  study  derived  from 
differences  in  the  data  obtained  from  the  two  participating 
instructors.   First,  although  revision  was  found  to  have  a 
statistically  significant  positive  effect  on  holistic  scores 
in  the  case  of  both  instructors,  the  revising  behavior  of  one 
instructor's  students  was  markedly  different  from  that  of  the 
other's.   Namely,  Instructor  Two's  students  engaged  in 
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considerable  multisentence  revising,  regardless  of  treatment, 
while  Instructor  One's  students  did  not  do  so.   The  fact  that 
both  sets  of  students  achieved  significant  improvement  in 
score  is  consistent  with  Gee's  (1987)  finding  that  the 
quantitative  characteristics  (i.e.,  unit  size,  functional 
category)  of  revising  behavior  may  not  correlate  with  the 
effectiveness  of  that  revising  behavior.   To  state  the  point 
in  its  simplest  terms,  the  findings  of  this  study  suggested 
that  more  revising  is  not  necessarily  better  revising,  nor 
would  it  seem  that  larger-scale  revising  is  necessarily  more 
effective  than  surface  editing  in  improving  holistic  scores . 
Instead,  the  distinctive  feature  between  effective  and 
ineffective  revision  is  aptness.   Students  must  sense  a 
dissonance  (Flower  &  Hayes,  1980)  between  what  their  texts 
say  and  what  the  students  mean  to  say.   Perhaps  Instructor 
Two's  students  were  aware  of  such  dissonances;  however,  the 
data  provide  neither  support  for  nor  disconf irmation  of  such 
an  inference.   Instructor  One's  students,  the  data  clearly 
indicated,  were  not  altering  the  meanings  of  their  texts  but 
eliminating  errors  in  the  encoding  of  meanings.   However,  the 
holistic  scorers  responded  about  equally  favorably  to  both 
kinds  of  revision.   This  finding  raises  the  question  of 
whether  holistic  scoring  is  an  appropriate  instrument  for 
measuring  changes  in  textual  quality  which  result  from 
experimental  treatments.   Huot  (1990)  has  raised  questions 
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about  the  validity  of  holistic  scoring  in  research  settings. 

.1  - 

More  research  is  needed  on  this  point . 

Another  point  to  be  raised  concerning  the  low 
reliability  coefficients  is  the  fact  that  the  differences 
among  raters  was  patterned,  not  erratic.   One  rater  scored 
essays  consistently  higher  than  the  other  two,  one  scored 
consistently  lower,  and  the  third  arrived  at  scores 
consistently  falling  between  the  other  two.   This  fact, 
combined  with  the  fact  that  all  final  quality  scores 
represented  an  averaging  of  the  three  raters'  scores, 
somewhat  mitigates  the  effects  of  the  low  reliability 
coefficients  achieved  in  this  study. 

Moreover,  although  Instructor  Two's  students  engaged  in 
considerable  large-scale  revision,  their  written  revision 
guide  responses  and  interview  comments  showed  scarcely  any 
articulation  of  comprehensive  methods  for  focusing  the 
meanings  of  their  first  drafts. 

The  revision  guides  employed  in  this  study  were  intended 
to  help  students  identify  needed  revisions  and  to  encourage 
them  to  consider  whole-text  issues.   However,  the  written 
revision  guide  responses  and  interview  data  strongly 
suggested  that  the  revision  guides  had  little  effect  on  the 
revising  the  students  did.   Perhaps  the  level  of  abstractness 
in  the  guide  items  made  them  too  difficult  to  comprehend. 
Certainly,  the  students'  written  responses  to  the  revision 
guides  indicated  either  an  unwillingness  or  an  inability  to 
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confront  the  issues  they  raised.   Moreover,  since  no  control 
groups  were  used,  no  statement  may  be  made  concerning  the 
contribution  of  the  revision  guides  to  the  significant 
improvement  of  the  students'  essays  from  first  to  final 
drafts.   The  researcher's  opinion  is  that  the  essays  may  have 
improved  about  the  same  amount  without  the  guides . 

As  for  the  influence  of  differing  topics  on  the  scores 
of  students'  essays,  the  present  study  offers  little  insight. 
The  statistical  analyses  showed  no  effect  for  topic  as  a 
variable  affecting  first-to-final-draft  improvement  for 
either  instructor.   For  Instructor  Two,  the  topic  variable 
did  have  a  significant  effect  on  essay  scores,  due  in  large 
measure  to  the  noticeable  decline  in  scores  between  Sample 
Essays  One  and  Two.   However,  the  effect  of  topic  on  essay 
quality  was  not  a  main  point  of  this  study. 

Implications  for  Teaching 

Many  writers  have  extolled  revision  as  a  sine  qua  non  of 
the  writing  process.   However,  few  researchers  have  sought  to 
isolate  revision  as  a  variable  to  determine  its  effect  on  the 
quality  of  texts.   This  study  contains  findings  (i.e.,  the 
fact  that  scores  improved  significantly  between  drafts  for 
all  four  treatment  groups)  which  imply  that  teachers  of 
writing  ought  to  expect  students  to  revise  their  writing. 
However,  the  findings  of  this  study  also  suggest  that 
students  need  help  with  thinking  through  the  subtle  problems 
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which  result  in  weak  writing.   These  problems,  in  the  opinion 
of  this  researcher,  have  their  ultimate  bases  in  a  writer's 
sense  of  purpose  and  awareness  of  audience. 

Much  has  been  made  in  composition  literature  concerning 
the  importance  of  balancing  the  concern  with  product  with  the 
need  to  help  students  experience  writing  as  a  process. 
Certainly,  the  conception  of  writing  as  a  recursive 
interaction  of  planning,  drafting,  revising,  and  editing  is  a 
distinct  improvement  over  earlier  models.   However,  there  is 
another  level  of  the  writing  process  which  should  be  added  to 
the  now-standard  process  model:   Students  need  to  have  a 
personal  investment  in  what  they  write  and  to  see  their 
writing  as  directed  at  a  person  or  persons  with  whom  they  are 
in  dynamic  two-way  communication  in  order  to  accomplish  well- 
defined  purposes.   Professional  writers  routinely  experience 
this  additional  level  of  the  writing  process;  students 
typically  do  not .   Several  writers  interested  in  the  problem 
of  teaching  writing  (Graves,  1983;  Moffett,  1968;  Murray, 
1978,  1982)  have  shown  how  instruction  may  be  organized  to 
include  purpose  and  audience  in  proper  proportion. 

The  students  involved  in  the  present  study  were  not 
writing  to  self-selected  audiences  in  order  to  achieve  a 
personally  important  goal.   They  were  writing  to  a  teacher  to 
obtain  a  grade.   They  were  not  revising  in  order  to  more 
effectively  reach  an  audience  and  achieve  a  personally 
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relevant  goal.   They  were  revising  to  eliminate  errors  and 
give  the  instructors  what  they  wanted. 

This  researcher  was  not  in  a  position  to  implement  a 
writing  curriculum,  nor  was  this  study  designed  to  describe 
the  classroom  instruction  the  students  experienced.   However, 
the  qualitative  data  collected  in  this  study  supported  the 
inference  that  these  40  typical  college  students  were  largely 
unaware  of  the  important  audience  and  purpose  concerns  that 
help  professional  writers  produce  effective  text.   As  they 
answered  the  target  questions,  students  did  not  mention  any 
concern  with  difficulties  a  reader  might  have  interpreting 
their  texts.   Moreover,  they  did  not  express  any  purpose  for 
writing  other  than  to  "give  the  teacher  what  she  wants." 

It  is  beyond  the  scope  of  this  study  to  address  in 
detail  the  problem  of  how  writing  instruction  should  be 
delivered.   The  point  being  made  here  is  that  under  the 
conditions  prevailing  in  this  study,  students  improved  their 
writing  through  revision  but  were  unable  to  clearly 
articulate  metacognitive  bases  for  revision.   Unquestionably, 
instructors  of  writing  need  to  help  students  become  aware  of 
why  revision  is  necessary.   As  Beach  (1989)  has  pointed  out, 
before  students  can  usefully  answer  the  kinds  of  questions 
posed  in  this  study's  revision  guides,  they  first  have  to  be 
capable  of  describing  for  themselves  what  they  have  done  in 
their  first  drafts,  and  why  they  have  done  so.   Following 
this  descriptive  phase,  according  to  Beach,  self-evaluation 
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has  a  better  chance  of  yielding  desirable  results.   Beach  has 
suggested  that  student-teacher  conferences  are  ideally  suited 
for  helping  students  become  more  aware  of  what  they  are  doing 
when  they  attempt  to  write  expository  prose.   The  qualitative 
data  collected  in  this  study  show  that  students  often  were 
unable  to  reconstruct  what  they  had  done  in  writing  and 
revising  their  texts.   They  lacked  labels  for  the  kinds  of 
thinking  they  were  doing.   In  general,  they  were  unable  to 
engage  in  the  kind  of  descriptive  analysis  of  their  own 
behavior  that  Beach  (1989)  posited  as  a  prerequisite  for 
successful  revising. 

In  summary,  the  findings  of  this  study  imply  that 
writing  teachers  should  include  required  revision  within 
their  curricula  but  that  students  need  assistance  in 
determining  the  kinds  of  revising  that  will  be  most  apt . 
Specifically,  writing  teachers  should  take  note  of  the 
difficulty  students  in  this  study  had  in  applying  revision 
guides  to  their  work.   Instructors  should  consider  training 
students  to  use  such  guides  before  asking  them  to  do  so. 
Determining  the  most  efficacious  form  of  training  for  using 
revision  guides  is  an  area  in  need  of  research.   Moreover, 
peer  evaluation  appears  to  be  no  more  or  less  effective  than 
self-evaluation  in  stimulating  effective  revision.   Judging 
from  the  reports  given  by  students  about  the  kinds  of  peer 
interaction  they  experienced  in  this  study,  teachers  of 
writing  should  consider  training  students  to  get  the  most 
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benefit  out  of  such  interaction.   Discovering  the  optimum 
training  procedures  for  interactive  peer  evaluation  of  essays 
is  another  area  in  need  of  research.   Finally,  teachers  of 
writing  need  to  devise  ways  and  means  to  help  students  make  a 
personal  investment  in  what  they  write  through  seeing  their 
writing  as  being  directed  at  a  well-defined  and  responsive 
audience  for  a  personally  meaningful  purpose. 

Implications  for  Research 

This  study  has  analyzed  both  quantitative  and 
qualitative  data  to  achieve  its  purposes.   Had  only  one  of 
these  types  of  data  been  collected,  the  study  would  have  been 
weakened.   This  researcher  has  heard  quantitative  analysis 
disparaged  by  qualitative  researchers  as  reducing  people  to 
faceless  numbers  and  human  behavior  to  cold,  hard  walls  of 
emotionless  decimal  arrays.   Conversely,  he  has  heard 
qualitative  analysis  disparaged  by  quantitative  researchers 
as  consisting  of  hopelessly  fuzzy  and  distorted  anecdotes 
shot  through  with  bias  and  hidden  agendas.   However,  if  the 
two  kinds  of  data  are  used  together,  as  has  been  done  in  this 
study,  quantitative  findings  may  be  related  to  real  people 
and  specific  behavior,  and  qualitative  findings  may  be  seen 
in  the  context  of  systematic  numerical  patterns.   In  this 
researcher's  opinion,  knowledge  about  writing  instruction  can 
only  gain  from  combining  the  two  kinds  of  data  and  will  only 
be  held  back  by  internecine  conflict. 
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Turning  to  more  specific  issues,  this  study  raised 
interesting  questions  for  future  research.   First,  what  do 
students  think  when  they  read  and  try  to  use  the  kinds  of 
revision  guides  employed  in  this  study?  Perhaps  a  study 
using  think-aloud  procedures  (Flower  &  Hayes,  1980) ,  in  which 
students  tape-record  their  responses  to  such  guides  as  they 
attempted  to  compose  written  responses,  would  reveal  problems 
of  comprehension  and  application,  leading  to  improved  guides 
and  training  methods  that  would  be  more  helpful  than  those 
used  in  this  study. 

Next,  what  kinds  of  classroom  instruction  would  best 
help  students  optimally  comprehend  revision  guides?   It 
should  be  borne  in  mind  that  the  revision  guides  used  in  this 
study  were  demanding  from  students  complex  metacognitive 
thinking  about  revising  their  essays.   Learning  how  students 
respond  to  the  difficult  cognitive  demands  inherent  in 
revision  guides  is  a  difficult  problem  which  will  require 
research  and  continuing  discussion. 

Furthermore,  what  kinds  of  classroom  instruction  help 
students  to  attain  valid  concepts  of  audience,  purpose,  the 
nature  of  revision,  and  the  nature  of  written  composition 
itself?   Possibly  a  series  of  ethnographic  studies,  combined 
with  quantitative  outcome-analysis,  would  shed  light  revision 
as  part  of  the  writing  process. 

Unfortunately,  the  reliabilities  achieved  by  the 
holistic  scorers  in  the  present  study  were  lower  than  were 
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hoped  for.   This  problem  was  greatest  with  respect  to  Sample 
Essay  One;  the  scorers'  reliability  was  as  low  as  .20  on  this 
essay.   A  possible  explanation  for  the  lower  reliabilities  on 
Sample  Essay  One  was  the  fact  that  it  was  a  personal- 
narrative  essay  (Instructor  One,  "How  I  Became  a  Florida 
'Gator'";  Instructor  Two,  "A  Memorable  Event  in  My  Life"), 
whereas  the  other  three  essays  conformed  to  well-defined 
rhetorical  modes:   definition,  cause/effect,  and  persuasion 
related  to  the  issue  of  affirmative  action.   Clearly,  Sample 
Essay  One  allowed  for  a  wider  range  of  approaches  and  also 
encouraged  students  to  display  their  personalities.   These 
characteristics,  in  the  researcher's  opinion,  resulted  in 
essays  which  could  be  judged  along  more  dimensions  of  quality 
than  the  more  formal  academic  writing  demanded  in  the 
subsequent  essays.   Research  is  needed  into  the  effect  of 
modes  of  discourse,  especially  personal  writing  versus 
academic  writing,  on  the  quality  scores  given  by  holistic 
raters,  and  on  the  inter-rater  reliabilities  they  achieve. 

In  addition,  the  revision  guides  used  in  this  study  may 
have  been  too  complex  and  abstract  to  be  of  much  help  to 
students.   Furthermore,  most  of  the  peer-evaluating  students 
did  not  perceive  the  work  they  did  with  each  other  to  be 
worthwhile.   Research  should  be  conducted  which  compares  the 
effects  of  different  kinds  of  revision  guides  and  various 
techniques  for  motivating  students  help  each  other  improve 
their  writing. 


The  ANOVA  tests  employed  in  this  study  showed  that  the 
final  drafts  by  all  four  treatment  groups,  regardless  of 
treatment  or  instructor,  scored  significantly  higher  than 
first  drafts.   Bridwell's  (1979)  study  shows  a  similar 
result,  but  her  study  was  primarily  an  analysis  of  the  kinds 
of  revision  her  subjects  did,  not  of  the  effect  of  revision 
on  textual  quality.   Moreover,  Bridwell  used  only  one 
occasion  of  writing  as  the  data  base  for  her  study.   More 
research  should  be  conducted  to  explore  the  effects  of 
revision  on  textual  quality. 

While  it  is  hoped  that  this  study  will  encourage 
teachers  of  writing  to  include  revision  in  their  thinking   .' 
about  course  design,  it  is  clear  that  more  research  is  needed 
on  classroom  instruction  that  will  help  students  understand 
the  importance  of  revision.   Moreover,  research  should  be  -' 
done  to  identify  ways  by  which  students  may  effectively  help 
each  other  revise  their  essays. 
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Table  A-1 

First    Draft    Smres  —  Instructor    One     (Scale:     1-18) 


Sampl 

.e  Essay 

Sample  Essay 

Sample  Essay 

Sample  Essay 

Student 

One 

Two 

Three 

Four 

SELF- 

-EVALUATORS 

111 

11 

5 

6 

5 

112 

12 

10 

13 

12 

113 

8 

12 

7 

8 

114 

6 

6 

9 

4 

115 

8 

3 

3 

6 

116 

13 

7 

6 

12 

117 

7 

7 

6 

2 

118 

7 

3* 

3 

1 

119 

12 

12 

9 

9 

110 

7 

3 

4 

7 

PEER 

EVALUATORS 

121 

-.- 

7 

13 

6 

8 

122 

11 

14 

12 

11    ■]:: 

123 

12 

9 

14 

9 

124 

10 

10 

10 

14 

125 

9 

10 

13 

8 

126 

8 

10 

11 

18 

127 

11 

5 

6 

11 

128 

10 

1 

8 

10 

129 

8 

10 

4 

6 

120 

12 

9 

9 

6 

♦Because  this   student   did  not   submit   an  Essay  Two,    this   score   is   the 
average  of  this   student's   other  three   scores. 
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Table  A-2 

Final   Draft    Scores — Instructor   One    (Scale:    1-18) 


Sampl 

.e  Essay 

Sample  Essay 

Sarr^le  Essay 

Sample  Essay 

Student 

One 

Two 

Three 

Four 

SELF- 

-EVALUATORS 

111 

12 

1 

6 

10 

112 

15 

7 

16 

9 

113 

9 

13 

7 

8 

114 

12 

9 

8 

5 

115 

14 

6 

7 

8 

116 

11 

6 

9 

12 

117 

11 

8 

4 

2 

118 

6 

3* 

3 

1 

119 

12 

17 

10 

14 

110 

8 

5 

11 

6 

PEER 

EVALUATORS 

121 

11 

13 

12 

11 

122 

11 

13 

13 

13 

123 

12 

12 

15 

13 

124 

13 

11 

11 

13 

125 

12 

10 

15 

12 

126 

10 

8 

12 

18 

127 

13 

5 

9 

7 

128 

10 

6 

11 

10 

129 

10 

7 

5 

9 

120 

13 

10   ^ 

7 

8 

*This   score   is   the  average   of   this   student's   other  three   scores. 


189 


Table  A-3 

First    Draft    Scores  — Insl-runtor   Two    (Scale:    1-18) 


Sample  Essay        Sample  Essay        Saitple  Essay        Sair^le  Essay 
Student  One  Two  Three  Four 


4  6  8 

6  14  15 

4  6  6 

6  10  9 

10  11  11 

2  13  16 

3  11  8 
10  9  10 

6  7  4 

8  7  1 


8  8  15 

12  12  15 

8  6  10 
11  11  7 
10  11  12 

6  6  13 

9  6  12 
15  14  13 

6  19 

6  9  9 


SELF-EVALUATORS 

211 

8 

212 

11 

213 

7 

214 

8 

215 

15 

216 

12 

217 

10 

218 

12 

219 

11 

210 

12 

PEER  EVALUATORS 

221 

10 

222 

12 

223 

9 

224 

8 

225 

12 

226 

13 

227 

11 

228 

10 

229 

11 

220 

9 
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Table  A- 4 

Final   Draft    Scores — Instructor   Two    (Scale:    1-18) 


Sait^le  Essay       Sample  Essay       Sample  Essay       Sample  Essay 
One  Two  Three  Four 


Student 


SELF-EVALUATORS 

211 

5 

212   ..   . 

12 

213 

9 

214 

9 

215 

16 

216 

14 

217 

9 

218 

10 

219 

13 

210 

9 

PEER  EVALUATORS 

221 

11 

222 

12 

223 

9 

224 

10 

225 

12 

226 

10 

227 

12 

228 

8 

229 

11 

220 

10 

11 

10 
5 

12 

10 
9 
9 

15 
4 
6 


9 
13 
10 

9 
15 

6 
12 
16 

9 
12 


8 

15 

8 

13 

11 

17 

11 

10 

9 

9 


14 
16 

8 
13 
13 

5 
12 
15 

8 
10 


8 

15 

7 

14 

14 

16 

9 

10 

12 

7 


18 
18 
11 
13 
10 
13 
17 
13 
12 
11 
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FIRST-TO-FINAL  DRAFT  CHANGES  IN  QUALITY  SCORE 


y^ 


Table  B-1 

First-to-Final-Draft    Changes    in   Quality   Score.    Instructor  One 


Sample   Essay        Sairple  Essay        Sait^le  Essay        Sample  Essay 
One  Two  Three  Four 


Student 


SELF-EVALUATORS 

111 

+1 

112 

+3 

113 

+1 

114 

+  6* 

115 

+  6* 

116 

-2 

117 

+4* 

118 

-1 

119 

0 

110 

+1 

PEER  EVALUATORS 

121 

+4 

122 

0 

123 

0 

124 

+3* 

125 

+3* 

126 

+2 

127 

+2 

128 

0 

129 

+2 

120 

+1 

_4** 

-3** 
+1 
+3* 
+3* 
-1 
+1 
0 
+4* 
+2 


0 

-1 

+3* 

+1 

0 
-2 

0 
+5* 
-3** 
-1 


0 

+3* 

0 
-1 
+4* 
+3 
-2 

0 
+1 
+7 


+6* 

+1 

+1 

+1 

+2 

+1 

+3* 

+3* 

+1 

-2 


+5* 
-3** 

0 
+1 
+2 

0 

0 

0 
+5* 
-7 


+3* 

+2 

+4* 

-1 

+4* 

0 
-4** 

0 

+3 
+2 


♦Successful   revision    (i.e.,    ^  3-point   improvement   in   final-draft   score) 
♦♦Unsuccessful   revision    (i.e.,    >   3-point   decline   in   final-draft   score) 


^; 
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Table  B-2 

First-to-Final-Draft    Changes    in   Oiiallty    j^rore.     Instructor   Two 


Sample  Essay 

Sample  Essay 

Sair^le  Essay 

Sait^le  Essay 

Student 

One 

Two 

Three 

Four 

SELF- 

-EVALUATORS 

211 

-3** 

+7* 

+2 

0 

212 

+1 

+4* 

+1 

0 

213 

+2 

+1 

+2 

+1 

214 

+  1 

+6* 

+3* 

+5* 

215 

+1 

0 

^ 

+3* 

216 

+2 

+7* 

+4* 

0 

217 

-1 

+6* 

0 

+1 

218 

-2 

+5* 

+1 

0 

219 

+2 

-2 

+2 

+8* 

210 

-3** 

-2 

+2 

+6* 

PEER 

EVALUA' 

TORS 

221 

+1 

+1 

+6* 

+3* 

222 

0 

+1 

+4* 

+3* 

223 

0 

+2 

+2 

+1 

224 

+2 

-2 

+2 

+  6* 

225 

0 

+5* 

+2 

-2 

226 

-3** 

0 

-1 

0 

227 

+1 

+3* 

+6* 

+5* 

228 

-2 

+1 

+1 

0 

229 

0 

+3* 

+7* 

+3* 

220 

+1 

+6* 

+1 

+2 

h\ 


*Successful  revision  (i.e.,  >  3-point  improvement  in  final-draft  score) 
**Unsuccessful  revision  (i.e.,  >  3-point  decline  in  final-draft  score) 
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Table  C-1 

Revisions  Madf^  in  First:  Drafts  —  Sample  Essay  One.  Instructor  One 


First  Draft 
Word 
Student   Count 

Surface 
( 

Word 
-numbe: 

Phrase  Clause 
r  of  occurrences- 

Sentence 
) 

Multi- 
Sentence 
(Word  Count) 

SELF- 

-EVALUATORS 

111 

620 

8 

15 

4 

1 

0 

0 

112 

880 

10 

10 

3 

0 

1 

0 

113 

750 

13 

5 

2 

1 

0 

86 

114 

820 

7 

19 

6 

0 

1 

130 

115 

950 

32 

24 

11 

1 

0 

0 

116 

1250 

34 

30 

15 

0   «• 

0 

45 

117 

710 

20 

17 

7 

0 

1 

0 

118 

720 

14 

30 

21 

8 

5 

35 

119 

700 

6 

12 

4 

3 

0 

0 

110 

660 

10 

23 

17 

4 

1 

91 

PEER  EVALUATORS 


121 

860 

25 

2 

5 

0 

0 

0 

122 

1130 

18 

48 

17 

8 

7 

38 

123 

1010 

16 

3 

4 

0 

0 

0 

124 

920 

9 

11 

6 

0 

0 

0 

125 

710 

2 

4 

1 

0 

0 

0 

126 

1390 

38 

12 

15 

0 

0 

0 

127 

740 

15 

2 

4 

0 

0 

0 

128 

630 

10 

5 

5 

0 

0 

0 

129 

900 

16 

10 

6 

1 

0 

241 

120 

580 

13 

7 

1 

0 

0 

0 

^^'■■ 
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Table  C-2 

Revisions  Made  in  First  Drafts  —  Sample  Essay  Two. Instructor  One 


First  Draft 
Word 
Student   Count 

Surface 
( 

Word 
-numbe: 

Phrase  Clause 
r  of  occurrences- 

Sentence 
) 

Multi- 
Sentence 
(Word  Count) 

SELF- 

-EVALUATORS 

111 

620 

5 

7 

6 

0 

0 

0 

112 

810 

8 

5 

1 

2 

1 

51 

113 

470 

1 

0 

0 

0 

0 

0 

114 

660 

13 

25 

14 

4 

2 

33 

115 

430 

13 

10 

6 

2 

2 

0 

116 

770 

16 

4 

12 

1 

1 

127 

117 

640 

7 

16 

4 

1 

1 

0 

118 

0 

0 

0 

0 

0 

0 

0 

119 

720 

1 

11 

2 

1 

2 

0 

110 

660 

4 

12 

1 

1 

2 

0 

PEER  EVALUATORS 


121 

630 

5 

3 

1 

0 

0 

0 

122 

710 

7 

9 

7 

0 

0 

0 

123 

500 

3 

6 

1 

0 

0 

82 

124 

720 

4 

1 

2 

0 

1 

0 

125 

710 

5 

10 

6 

3 

0 

0 

126 

860 

15 

10 

8 

1 

0 

0 

127 

400 

8 

7 

4 

2 

0 

0 

128 

560 

17 

18 

7 

2 

2 

29 

129 

620 

12 

13 

2 

0 

0 

0 

120 

530 

3 

1 

1 

2 

0 

0 
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Table   C- 

-3 

Revisions    Made    in 

rirst 

Drafts 

— Samcle 

Essav   Three. 

Instructor 

One 

First  Draft 
Word 
Student        Count 

Surface 
/ , 

Word     1 

Phrase     Clause 
of  occurrences- 

Sentence 
) 

Multi- 
Sentence 
(Word  Count) 

\ 

""nuitiDer 

SELF-EVALUATORS 

111 

530 

7 

3 

7 

2 

0 

0 

112 

710 

1 

2 

1 

0 

0 

0 

113 

690 

0 

0 

0 

0.     . 

0 

0 

114 

590 

6 

3 

4 

2 

i^ 

0 

115 

450 

2 

14 

5 

0 

'       0 

0 

116 

520 

2 

3 

1 

2 

2 

256 

117    'i.- 

620 

5 

11 

6 

a 

1 

0 

118 

480 

0 

0 

0 

0 

0 

0 

119 

620 

0 

7 

3 

2 

0 

0 

110 

610 

5 

11 

8 

0 

2 

47 

PEER  EVALUATORS 


121 

510 

7 

8 

4 

0 

0 

.0 

122 

720 

0 

2 

0 

0 

t 

0 

123 

690 

2 

0 

4 

0 

0 

0 

124 

720 

2 

3 

0 

0 

t 

78 

125 

610 

4 

1 

1 

2 

V    0 

0 

126 

840 

4 

2 

1 

2 

0 

0 

127 

460 

7 

2 

1 

0 

0 

0 

128 

480 

4 

9 

3 

4 

3 

221 

12f 

650 

0 

0 

0 

0 

0 

0 

,      120 

500 

1 

4 

1 

0 

0 

0 

b.--'     ,, 

-( 
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Table  C-4 

Revisions  Made  in  First  Drafts — Sample  Essay  Four.  Instructor 
One 


First  Draft  Multi- 

Word      Surface  Word  Phrase  Clause   Sentence   Sentence 
Student   Count      ( number  of  occurrences )    (Word  Count) 


SELF-EVALUATORS 

111  730  20  11  9  0  0  0 

112  640  8  0  0  0  0  0 

113  450  0  0  0  0  0  0 

114  510  13  12  10  1  0  31 

115  520  27  12  4  0  0  0 

116  780  9  9  3  0  1  37 

117  560  0  0  0  0  0  0 

118  560  0  0  0  0  0  0 

119  590  30  13  4  0  0  0 
110        600  31  15  6  0  0  101 

PEER  EVALUATORS 


121 

630 

5 

8 

4 

0 

1 

0 

122 

640 

1 

7 

5 

0 

0 

0 

123 

670 

6 

0 

0 

0 

0 

0 

124 

760 

2 

7 

1 

1 

0 

0 

125 

540 

2 

6 

4 

4 

2 

0 

126 

630 

1 

1 

1 

0 

0 

0 

127 

420 

10 

8 

2 

0 

1 

0 

128 

620 

19 

6 

2 

0 

0 

0 

129 

720 

40 

17 

5 

0 

0 

0 

120 

570 

16 

10 

3 

0 

0 

0 
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Table   C-5 

Revisions    Made    in    First.   Draft.5^  —  Sample    Essay   One.     Instructor   Two 


First   Draft  Multi- 

Word               Surface     Word     Phrase     Clause      Sentence        Sentence 
Student        Count  ( number  of   occurrences )         (Word  Count) 


SELF-EVALUATORS 

211  570  7  9  16  0  4  44 

212  480  3  9  6  -S;  '1  '  3  132 
2ia        610  5  9  12  .1  .  1  146 

214  540  3  15  3  5  1  0 

215  620  5  10  8  9  3  0 


9 

16 

9 

6 

9 

12 

15 

3 

10 

8 

36 

24 

14 

16 

6 

2 

7 

5 

13 

8 

216  740  7  36  24  8  0  284 

217  450  3  14  •  |6  9  10  20 

218  560  0  6  2  4  1  0 

219  630  3       7  5  4  2  0 
210        690  3  13  8  6  1  0 

PEER  EVALUATORS 


221 

460 

0 

0 

0 

0 

1 

0 

222 

500 

0 

2 

0 

0 

0 

0 

223 

490 

1 

4 

8 

2 

0 

56 

224 

500 

15 

15 

12 

9 

5 

16 

225 

690 

13 

20 

21 

5 

6 

12  9 

226 

720 

19 

3 

2 

0 

1 

0 

227 

530 

1 

1 

3 

1 

0 

0 

228 

760 

4 

6 

3 

1 

0 

0 

229 

860 

1 

21 

7 

3 

1 

0 

220 

600 

0 

2 

3 

1 

6 

0 

''f: 
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Table  C-6 

Revisions  Made  in  First  Drafts — Sample  Essay  Two^  Instructor  Two 


First  Draft 
Word 
Student   Count 

Surface 
( 

Word 
-numbe: 

Phrase  Clause 
c   of  occurrences- 

Sentence 
) 

Multi- 
Sentence 
(Word  Count) 

SELF- 

-EVALUAT0R3 

211 

330 

3 

2 

2 

0 

0 

962 

212 

480 

6 

10 

8 

1 

4 

293 

213 

430 

1 

6 

9 

7 

4 

68 

214 

730 

0 

2 

0 

0 

4 

1270 

215 

680 

5 

0 

0 

0 

0 

0 

216 

530 

1 

4 

0 

1 

4 

122 

217 

220 

1 

3 

9 

0 

1 

454 

218 

460 

0 

10 

6 

2 

3 

805 

219 

440 

11 

1 

1 

1 

1 

0 

210 

610 

9 

IS 

13 

2 

6 

0 

PEER  EVALUATORS 


221 

450 

2 

6 

4 

1 

3 

100 

222 

530 

0 

1 

0 

1 

102 

223 

490 

2 

2 

2 

1 

53 

224 

420 

2 

7 

3 

2 

164 

225 

610 

1 

4 

6 

3 

217 

226 

290 

0 

0 

0 

0 

0 

227 

560 

5 

34 

10 

2 

132 

228 

740 

5 

10 

14 

8 

2 

34 

229 

650 

5 

12 

15 

4 

3 

0 

220 

360 

1 

10 

8 

2 

4 

45 
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Table 

c- 

-7 

. :  - 

Revisions    Made    in 

First_ 

Dxafts_ 

— Sample   Essav   Three, 

Instructor 

Two 

First   Draft 

,  ■  ■-  •  ^'  ■.'■" 

Multi- 

Word 

Surface 

Word 

Phrase 

Clause     Sentence 

Sentence 

Student 

Count 

( 

— number 

of  occurrences ) 

(Word  Count) 

SELF-EVALUATORS 

211 

560 

0 

3 

2 

0    '   [}'''¥' ^■ 

1108 

212 

620 

2 

6 

6 

0          ^0 

99 

.  213 

520 

1 

14 

3- 

'   -3.  ^        "  1 

0 

'^M  ■' 

1 

790 

7 

17 

17- 

^^■^-•V-;;-5 

460 

215 

860 

2, 

2 

10 

':•■*-     ■  ■■■■■f     . 

348 

.■2ir.;' 

700 

4 

V 

> 

-      11--. 

12 

'«■    ■'■  :,.^S'^ 

564 

217 

750 

$ 

0    r 

0 

..  0  "■  ■"';"f;v-- 

0 

218 

770 

6 

■^     t  ' 

8- 

2         ^^3 

0 

219 

690 

7 

11 

11 

2      -' r::--t' 

23 

210 

590 

4 

12 

8 

3                  4 

281 

PEER   EVALUATORS 


.>. 


221 

670 

7 

12 

7 

2 

5 

436 

222 

760 

0 

3 

3 

0 

0 

0 

223 

490 

1 

0 

0 

0 

'  3 

47 

224 

610 

9 

14 

16 

2 

3 

0 

225 

740 

1 

10 

16 

4 

7 

698 

226 

630 

3 

10 

7 

0 

3 

0 

227 

660 

3 

10 

8 

7 

4 

819 

228 

850 

0 

6 

5 

1 

2 

208 

229 

260 

3 

0 

1 

2 

2 

0 

220 

520 

0 

7 

2 

1 

2 

101 

f"'--- 

202 


Table   C-8 

Revisions    Made    in    First    Drafts  — Rampl  e   Essav   Four.     Instructor 
Two 


First  Draft  Multi- 

Word               Surface     Word     Phrase     Clause      Sentence        Sentence 
Student        Count  ( number  of   occurrences )  (Word  Count) 


SELF -E VALUATORS 

211  840  0  0  0  0  0  0 

212  1080  0  0  0  0  0  0 

213  870  11  20  11  4  6  197 

214  880  2  5  6  3  1  1565 

215  1540  4  10  12  3  5  477 


0 

0 

0 

0 

20 

11 

5 

6 

10 

12 

61 

54 

22 

15 

8 

17 

2 

0 

32 

10 

216  1120  5  61  54  15  0  0 

217  910  7  22  15  4  6  126 

218  770  5  8  17  7  1  0 

219  600  0  2  0  0  1  1449 
210        880  8  32  10  4  3  360 

PEER  EVALUATORS 


221 

950 

1 

3 

3 

1 

2 

728 

222 

810 

12 

3 

14 

1 

0 

66 

223 

710 

2 

0 

2 

0 

0 

67 

224 

600 

6 

12 

9 

3 

4 

57 

225 

1020 

0 

0 

0 

0 

0 

0 

226 

840 

5 

12 

14 

1 

2 

55 

227 

760 

0 

5 

1 

0 

0 

1702 

228 

810 

0 

0 

0 

0 

0 

0 

229 

810 

1 

4 

14 

0 

1 

140 

220 

580 

2 

6 

9 

2 

3 

366 

&  ^ 

f^-^ 


APPENDIX  D 
REVISION  GUIDES  USED  IN  CONJUNCTION  WITH  THE  STUDY 


Revision  Guide — Assignment  #1 


Directions:     Number  the  lines  of  the  essay  you  are  working 

on.   Whenever  appropriate,  refer  to  parts  of 
the  essay  by  line  number  as  you  respond  to  the 
questions  and  directions. 


1.    What  are  the  three  most  important  generalizations  in  the 
essay?  ■ 


2.    Are  these  generalizations  supported  by  examples, 
quotations,  logical  argumentation,  anecdotes? 


If  not,  what  support  could  they  have  received? 


If  so,  how  effective  is  the  support  given  to  these  three 
generalizations? 


Change  ten  words  or  phrases  in  the  essay  without 
changing  the  general  meaning  of  the  text.   In  other 
words,  find  ten  places  where  the  essay  could  express  the 
same  thoughts  using  different  words. 


4.    What  feature  of  the  essay  do  you  like  best? 
Why? 
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Rf^vision  Guidf? — Narration 
(Sample  Essay  One) 


Directions:     Number  the  lines  of  the  essay  you  are  working 

on.   Whenever  appropriate,  refer  to  parts  of 
the  essay  by  line  number  as  you  respond  to  the 
questions  and  directions  below. 


What  is  the  main  point  or  purpose  of  the  narrative? 
Explain  how  you  know  or  why  you  cannot  tell.  (5-10 
sentences) 


Did  the  writer  include  concrete  details  so  that  the 
reader  can  form  a  clear  mental  picture  of  the  story 
being  told?   If  so,  list  and  give  the  location  of  a 
maximum  of  five  of  these  concrete  details.   In  addition, 
list  and  give  the  location  of  a  maximum  of  five  vague 
expressions  or  unnecessary  details  in  the  narrative. 


Briefly  describe  the  order  (sequence)  in  which  the 
writer  presents  the  various  parts  of  the  narrative. 
Does  the  narrative  employ  any  of  the  following: 
chronological  order,  flashback,  slow-motion,  stop- 
action,  simultaneous  action?   Do  you  think  the 
sequencing  of  the  narrative  is  done  successfully?  Why 
or  why  not?   (5-10  sentences) 


(a)  What  verb  tense (s)  does  the  writer  use  in  the 
narrative?  Do  you  agree  with  the  choices  made  by 
the  writer?  Why  or  why  not? 

(b)  How  does  the  writer  handle  the  passage  of  time  in 
the  narrative?   Does  the  writer  use  transitional 
expressions  as  time  and  sequence  markers?   If  so, 
indicate  the  location  of  a  maximum  of  three  of 
these  time  and  sequence  markers.   In  addition, 
indicate  the  location  of  a  maximum  of  three  places 
where  more  clarity  concerning  the  passage  of  time 
is  needed. 


Describe  the  persona  which  emerges  from  the  narrative. 
Give  three  examples  form  the  narrative  which  lead  you  to 
this  characterization  of  the  writer's  persona. 


205 
Revision  finidf^ — Pror.f^ss  Analysis 


Does  the  writer  orient  the  reader  to  the  process 
presented  in  the  essay?   For  instance,  does  the  writer 

(a)  Place  the  process  in  context? 

(b)  Discuss  the  significance  of  the  process? 

(c)  Attempt  to  pique  the  readers'  interest  concerning 
the  process? 


What  are  the  main  steps  or  stages  in  the  process 
presented  in  the  essay?  Are  these  steps  distinct  or  do 
they  overlap? 


/   3.    Starting  with  the  second  paragraph,  briefly  indicate  why 
you  think  the  writer  chose  to  begin  each  new  paragraph. 
•■  :     What  changes  would  you  make  in  the  paragraphing? 


What  background  information  does  the  writer  provide  as 
the  discussion  of  the  process  progresses?   (Make  a 
list.) 

(a)  In  what  way  is  this  background  information  helpful? 

(b)  Is  any  of  it  unnecessary? 

(c)  Are  there  any  important  unanswered  questions  in 
your  mind  concerning  background  information? 


What  is  the  essay's  greatest  strength? 


What  is  the  essay's  greatest  weakness? 


206 


i  I  ...  ■■  ' 


Rf^vision  fiuide — Dpfinit.ion 
(Sample  Essay  Two) 


Does  the  writer  supply  a  context  or  background  for  the 
definition  given  in  the  essay?   Is  a  distinction  made 
between  cultural  and  personal  definitions?   Is  the 
context /background  adequate?  Why  or  why  not? 


Is  the  tone  consistent  throughout  the  essay?  Does  the 
tone  shift  among  formal,  informal,  and  casual?   Evaluate 
the  appropriateness  of  the  tone  in  the  essay? 


(a)  What  method  or  methods  does  the  writer  use 

(etymology,  connotation,  examples,  negation)  to 
develop  the  definition  essay?   Cite  types  and 
locations .   Do  you  agree  with  this  choice  of 
method?  Why  or  why  not? 

(b)  What  method  or  methods  should  be  added  to  those 
already  employed  in  the  essay?   Explain  your 
answer . 


Are  there  any  unexamined  stock  phrases  or  cliches  in  the 
essay?   Cite  locations. 


Is  the  definition  given  in  the  essay  incomplete  in  any 
way?   If  so,  what  is  missing?   If  not,  justify  your 
answer . 


207 

Revision  Guide — Classification 


Evaluate  the  introduction  of  the  essay.   Does  the  writer 
clearly  indicate  how  the  body  of  the  essay  will  be 
organized?   How  could  the  introduction  be  improved? 


Describe  in  a  few  words  how  the  writer  divides  the 
subject  of  the  essay  into  separate  categories.   Are 
these  categories  appropriate  and  adequate?  Explain  your 
answer . 


What  does  the  writer  do  to  make  the  essay  interesting? 
Does  the  writer  use  humor,  surprise,  irony?  How  could 
the  essay  be  made  more  interesting  for  the  reader? 


Into  what  categories  other  than  the  ones  chosen  bv  the 
writer  could  the  subject  of  the  essay  have  been  divided? 
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Rf^vision  Guide — Cause/Effect 
(Sample  Essay  Three) 


1.    Does  the  writer  discuss  mainly  causes,  mainly  effects, 
or  both  in  the  essay? 


2.    How  well  does  the  writer  establish  the  topic  of  the 

essay?   In  other  words,  to  what  extent  are  the  causes 
and/or  effects  under  discussion  precisely  and  explicitly 
defined?   Explain  your  answer. 


What  causes  and/or  effects  has  the  writer  neglected  to 
mention  in  the  essay?   Explain  your  answer. 


4 .    Evaluate  the  order  in  which  the  writer  chooses  to 

identify  and  discuss  the  various  causes  and/or  effects 
in  the  essay.   Would  a  different  order  work  better? 
Explain  your  answer. 


Has  the  writer  dealt  with  long-term  as  well  as  short- 
term  causes  and/or  effects  in  the  essay?   Is  it 
appropriate  or  even  necessary  for  the  write  to  do  so? 
Explain  your  answer. 


■«.■  i- 


5?- 


209 


Revision  Guide — Argumentation 
(Sample  Essay  Four) 


Evaluate  the  way  the  writer  introduces  the  controversy 
underlying  the  essay.   Are  two  (or  more)  conflicting 
positions  regarding  the  topic  clearly  defined?   Explain 
your  answer. 


How  effectively  does  the  writer  use  logic  to  support  his 
or  her  position?   Give  an  example  of  an  explicitly 
stated  application  of  logical  reasoning  in  the  essay. 
Evaluate  the  effectiveness  of  the  example  you  choose. 
If  you  cannot  find  such  an  example,  briefly  discuss  the 
extent  to  which  you  think  the  essay  suffers  as  a  result. 


*•-  3.    How  well  does  the  writer  counter  anticipated  objections 
to  his  or  her  own  arguments?   Explain  your  answer. 

4.    Does  the  writer  employ  emotional  language  to  support  his 
or  her  argument?   If  not,  is  this  a  fault?   If  so,  how 
effectively  does  the  writer  use  emotional  language  to 
advance  his  or  her  argument?   Explain  your  answer. 


iff. 
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